-- Logs begin at Tue 2022-01-11 03:18:21 UTC, end at Tue 2022-01-11 04:22:01 UTC. -- Jan 11 03:49:10.671596 dv-cinder-819778-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 03:49:10.678803 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 03:49:10 2022] *** Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: nodename: dv-cinder-819778-4-iscsi Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: machine: x86_64 Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: clock source: unix Jan 11 03:49:10.680739 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: pcre jit disabled Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: detected number of CPU cores: 4 Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: current working directory: / Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: detected binary path: /usr/bin/uwsgi-core Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: your processes number limit is 47680 Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: your memory page size is 4096 bytes Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: detected max file descriptor number: 2048 Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: lock engine: pthread robust mutexes Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: thunder lock: enabled Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 03:49:10.681225 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 03:49:10.733183 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: Python main interpreter initialized at 0x55602c9909c0 Jan 11 03:49:10.733183 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: python threads support enabled Jan 11 03:49:10.733183 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: your server socket listen backlog is limited to 100 connections Jan 11 03:49:10.733183 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: your mercy for graceful operations on workers is 90 seconds Jan 11 03:49:10.733558 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 03:49:10.733634 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: *** Operational MODE: preforking *** Jan 11 03:49:10.733889 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: *** uWSGI is running in multiple interpreter mode *** Jan 11 03:49:10.733889 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: spawned uWSGI master process (pid: 101777) Jan 11 03:49:10.734078 dv-cinder-819778-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 03:49:10.735439 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 1 (pid: 101778, cores: 1) Jan 11 03:49:10.735439 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: spawned uWSGI worker 2 (pid: 101779, cores: 1) Jan 11 03:49:10.735439 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 03:49:12.495117 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:49:12.495117 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Jan 11 03:49:12.495815 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:49:12.495815 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: from cryptography.utils import int_from_bytes Jan 11 03:49:12.497546 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:49:12.497546 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Jan 11 03:49:12.498571 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:49:12.498571 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: from cryptography.utils import int_from_bytes Jan 11 03:49:15.058667 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 03:49:15.059319 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 03:49:15.059436 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 03:49:15.059528 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 03:49:15.059883 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 03:49:15.059973 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 03:49:15.060059 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 03:49:15.060199 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 03:49:15.060405 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.060623 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 03:49:15.061291 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.061386 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 03:49:15.061623 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.061803 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.061978 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062143 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062320 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062478 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062642 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062808 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.062970 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063153 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063296 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063476 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063635 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063806 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.063892 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064135 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064220 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064481 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064573 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-4-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064754 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.064839 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065082 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065167 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065419 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-4-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065515 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065780 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.065870 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066094 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066179 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066411 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066507 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066727 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.066818 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067046 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067233 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067626 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067754 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067867 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.067981 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068194 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068326 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068516 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068631 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068834 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.068961 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069157 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069292 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069504 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069636 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069854 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.069980 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070176 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070316 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070489 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070613 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070815 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.070939 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-4-iscsi {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.071152 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.071280 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.071476 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.071605 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.071810 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072010 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-4-iscsi {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072209 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072340 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072535 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072669 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072851 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.072987 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073180 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073292 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073509 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073600 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073854 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.073946 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074205 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074298 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074541 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074630 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074867 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.074956 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075192 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075276 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075503 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075588 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075821 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.075922 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076160 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076246 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076491 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076580 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076800 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.076884 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077114 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077206 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077371 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077465 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077713 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.077813 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078042 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078127 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078321 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078405 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078645 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078738 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.078935 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079031 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079188 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079305 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079514 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079640 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079842 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.079934 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080151 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080235 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080467 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080620 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080781 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.080934 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081095 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081410 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081553 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081730 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.081883 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082052 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082207 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082356 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082493 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082671 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082815 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.082981 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083131 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083291 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083443 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083589 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083748 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.083899 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084051 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084251 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084400 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084545 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084689 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084835 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.084973 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085180 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085324 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085508 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085652 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085856 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.085996 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086162 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086315 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086492 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086643 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086793 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.086931 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087107 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087421 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087572 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087751 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.087904 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088066 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088215 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088386 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088538 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088683 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088820 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.088956 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089092 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089235 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089380 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089541 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089708 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.089884 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090041 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090201 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090353 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090514 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090659 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090821 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.090965 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091136 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091288 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091450 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091592 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091781 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.091934 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092097 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092411 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092553 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092719 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.092862 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093031 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093176 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093344 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093487 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093655 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.093829 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094007 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094200 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094342 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094479 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094614 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094757 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.094908 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095047 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095214 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095357 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095527 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095684 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095841 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.095978 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096124 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096261 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096441 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096601 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096816 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.096955 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097092 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097228 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097364 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097499 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097648 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097831 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.097992 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098137 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098307 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098450 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098638 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098783 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.098948 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099091 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099260 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099402 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099582 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099725 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.099878 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100015 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100194 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100345 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100520 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100666 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100839 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.100983 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101157 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101324 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101505 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101644 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101810 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.101969 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102107 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102253 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102396 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102540 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102683 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.102828 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103003 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103156 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103295 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103429 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103620 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103762 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.103917 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.104062 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.104252 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.104394 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.104573 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.104716 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.104891 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.105035 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.105224 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:49:15.105376 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.105549 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.105751 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.105917 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106058 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106241 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106387 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106568 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106725 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.106888 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.107040 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.107209 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.107353 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108058 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108215 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108378 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108531 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108695 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.108836 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109016 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109168 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109340 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109482 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109660 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.109852 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110003 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110148 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110317 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110473 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110637 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110788 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.110952 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111104 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111273 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111417 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111598 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111757 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.111930 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112084 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112252 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112396 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112549 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112688 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.112899 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113051 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113227 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113369 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113551 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113723 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.113913 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114057 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114242 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114386 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114577 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114735 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.114885 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115028 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115200 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115344 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115522 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115666 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.115854 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116010 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116157 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116293 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116475 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116630 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116819 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.116962 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117141 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117285 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117462 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117613 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117804 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.117943 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118103 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118247 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118418 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118572 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118727 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.118865 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119038 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119183 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119364 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119518 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119681 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.119824 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120000 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120144 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120331 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120549 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120690 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120837 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.120973 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121119 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121265 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121402 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121538 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121700 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.121895 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122050 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122205 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122346 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122519 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122664 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122850 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.122993 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.123742 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.123894 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124034 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124178 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124355 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124508 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124654 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124792 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.124970 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125115 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125294 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125447 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125609 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125789 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.125951 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126106 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126252 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126403 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126583 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126726 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.126901 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127044 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127221 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127392 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127555 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127698 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.127880 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128024 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128170 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128307 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128507 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128652 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128841 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.128985 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129158 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129300 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129455 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129592 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129793 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.129950 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130101 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130239 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130406 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130557 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130718 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.130862 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131033 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131179 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131347 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131512 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131658 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131802 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.131951 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132095 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132240 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132383 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132543 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132702 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132850 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.132994 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133166 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133320 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133458 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133602 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133796 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.133944 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134090 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134228 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134431 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134585 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134724 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.134867 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135041 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135185 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135396 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135550 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135717 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.135863 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136045 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136187 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136367 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136511 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136690 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.136844 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137007 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137157 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137328 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137482 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137649 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137820 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.137992 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138136 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138314 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138457 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138654 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138797 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.138983 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139133 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139280 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139417 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139613 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139758 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.139931 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140085 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140249 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140391 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140557 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140707 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.140880 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141037 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141208 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141351 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141525 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141732 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.141911 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142063 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142208 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142351 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142511 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142655 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142833 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.142986 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143150 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143299 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143467 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143621 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143782 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.143934 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144100 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144249 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144422 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144565 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144740 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.144889 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145060 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145211 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145377 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145528 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145714 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.145859 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146027 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146182 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146349 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146502 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146648 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146785 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.146962 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147112 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147295 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147439 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147610 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147767 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.147935 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148086 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148231 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148377 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148561 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148704 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.148880 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149025 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149197 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149349 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149516 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149666 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149846 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.149995 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.150160 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.150376 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.150523 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.150667 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151057 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151203 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151340 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151487 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151626 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151762 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.151938 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152099 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152386 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152555 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152700 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.152861 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153004 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153170 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153316 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153486 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153642 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153833 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.153983 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154137 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154275 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154483 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154628 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154809 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.154959 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155113 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155258 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155409 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155565 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155732 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.155884 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156047 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156193 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156337 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156480 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156623 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156776 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.156921 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157064 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157264 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157416 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157583 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157771 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.157923 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158078 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158222 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158365 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158515 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158672 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158818 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.158961 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159138 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159289 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159486 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159660 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159808 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.159953 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160107 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160251 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160403 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160549 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160692 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160834 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.160978 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161121 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161277 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161423 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161566 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161745 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.161896 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162063 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162217 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162362 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162529 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162680 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162847 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.162999 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.163152 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.163361 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.163510 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.163653 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.163846 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164017 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164164 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164307 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164482 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164731 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.164882 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.165072 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.165232 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.165384 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.165670 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.165900 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166055 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166214 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166369 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166519 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166664 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166807 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.166963 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167108 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167292 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167444 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167638 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167789 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.167975 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168128 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168324 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168476 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168619 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168769 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.168921 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.169066 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.169217 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.169363 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.169519 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.169664 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.170339 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.170491 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.170635 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.170797 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.170943 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171094 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171239 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171384 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171527 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171671 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171814 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.171975 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172129 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172284 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172430 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172582 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172736 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.172887 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173050 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173207 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173360 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173506 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173649 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.173858 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174005 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174157 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174311 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174456 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174600 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174754 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.174936 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175161 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175309 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175459 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175604 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175748 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.175898 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176051 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176196 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176345 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176490 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176645 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176789 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.176941 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177092 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177243 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177388 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177532 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177702 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.177854 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178022 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178174 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178342 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178494 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178660 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178806 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.178950 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179094 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179244 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179388 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179563 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179715 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.179881 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180033 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180198 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180349 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180502 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180657 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180801 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.180945 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181089 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181240 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181411 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181562 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181761 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.181914 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182068 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182226 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182377 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182522 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182676 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182820 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.182965 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183117 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183261 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183405 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183548 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183691 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183842 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.183996 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184146 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184292 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184446 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184590 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184742 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.184888 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.185032 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.185174 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.185317 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.185459 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.186211 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.186398 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.186546 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.186690 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.186856 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187018 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187173 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187319 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187469 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187620 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187765 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.187909 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188061 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188213 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188380 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188525 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188670 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188826 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.188981 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189124 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189269 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189413 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189595 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189804 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.189961 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190106 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190249 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190424 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190571 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190727 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.190873 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191027 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191172 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191316 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191467 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191624 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191769 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.191920 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192065 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192209 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192380 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192526 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192670 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192814 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.192969 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193113 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193265 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193411 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193554 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193721 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.193871 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194026 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194185 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194356 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194504 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194654 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194813 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.194958 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195115 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195260 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195403 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195548 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195691 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195847 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.195999 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196144 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196316 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196462 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196614 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196778 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.196923 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197073 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197219 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197363 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197507 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197664 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.197868 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198014 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198158 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198310 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198461 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198615 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198777 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.198923 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199066 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199210 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199360 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199513 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199698 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199853 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.199998 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200142 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200294 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200447 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200592 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200777 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.200933 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201098 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201264 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201411 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201572 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201736 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.201922 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202066 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202223 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202368 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202512 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202663 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202824 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.202971 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203127 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203285 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203430 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203573 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203724 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.203945 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204092 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204243 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204389 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204540 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204692 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.204855 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205007 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205152 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205296 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205440 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205583 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205760 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.205911 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206057 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206201 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206345 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206487 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206654 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206799 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.206967 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207121 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207291 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207451 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207597 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207740 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.207922 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208072 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208240 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208400 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208553 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208708 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.208859 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209004 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209226 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209385 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209530 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209728 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.209881 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210025 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210180 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210336 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210482 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210626 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210841 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.210992 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211171 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211325 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211499 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211649 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211794 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.211936 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212115 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212265 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212410 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212555 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212708 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.212852 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213040 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213200 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213347 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213492 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213636 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213811 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.213972 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214119 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214287 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214443 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214591 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214757 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.214903 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215046 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215291 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215442 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215622 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215784 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.215931 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216081 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216401 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216645 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216827 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.216985 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217138 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217284 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217428 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217619 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217820 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.217969 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218112 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218257 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218400 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218580 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218733 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.218894 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219038 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219215 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219367 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219547 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219700 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.219866 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220017 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220189 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220346 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220501 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220602 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220832 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.220921 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221163 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221252 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221482 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221570 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221836 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.221931 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222174 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222279 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222514 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222606 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222841 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.222927 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223178 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223287 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223508 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223602 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223825 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.223933 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224139 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224258 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224457 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224589 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224772 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.224927 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225082 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225245 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225413 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225562 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225766 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.225930 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226089 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226408 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226567 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226725 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.226902 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227036 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227220 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227346 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227546 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227680 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227870 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.227991 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228192 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228324 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228509 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228645 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228824 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.228976 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229162 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229309 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229476 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229625 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229851 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.229985 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230180 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230320 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230514 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230600 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230851 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.230942 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231169 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231256 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231505 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231590 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231826 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.231912 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.232143 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.232236 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.232983 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233074 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233300 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233387 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233641 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233758 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.233985 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234069 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234316 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234403 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234645 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234730 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.234977 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235074 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235295 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235389 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235609 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235694 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.235922 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236014 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236243 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236337 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236558 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236650 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236869 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.236954 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237183 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237277 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237498 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237589 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237830 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.237930 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238143 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238241 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238455 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238542 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238775 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.238859 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239086 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239171 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239396 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239486 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239710 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.239796 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240018 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240103 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240329 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240415 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240642 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240734 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.240970 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241060 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241290 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241376 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241606 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241712 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.241947 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242033 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242261 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242345 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242614 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242708 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.242928 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243013 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243259 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243349 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243584 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243673 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243908 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.243993 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244231 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244315 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244548 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244681 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244869 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.244968 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245194 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245290 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245511 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245606 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245851 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.245950 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246178 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246263 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246501 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246586 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246821 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.246907 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.247146 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.247347 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.247468 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.247690 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.247801 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.248040 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.248186 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.248894 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.248990 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.249219 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.249510 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.249601 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.249879 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.249966 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250200 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250292 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250520 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250602 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250840 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.250932 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251156 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251240 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251478 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251561 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251803 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.251897 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252125 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252211 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252447 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252531 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252771 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.252898 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253093 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253178 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253417 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253508 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253762 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.253851 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254114 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254197 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254443 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254539 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254756 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.254847 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255080 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255179 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255404 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255510 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255723 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.255809 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256042 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256127 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256362 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256457 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256684 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.256769 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257004 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257096 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257322 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257409 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257639 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257781 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.257984 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258067 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258302 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258388 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258623 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258713 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.258950 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259049 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259272 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259365 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259591 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259675 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.259915 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260008 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260234 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260318 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260584 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260760 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.260919 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261084 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261247 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261426 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261576 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261788 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.261934 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.262126 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.262449 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.262533 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.262772 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.262857 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263109 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263207 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263441 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263533 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263771 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.263854 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264095 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264181 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264419 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264502 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264730 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.264815 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265060 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265147 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265387 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265522 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265695 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.265793 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266027 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266111 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266340 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266424 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266672 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266876 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.266995 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267227 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267313 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267550 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267635 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267886 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.267980 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.268222 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.268469 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.268562 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.268828 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.268922 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269162 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269247 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269470 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269554 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269807 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.269912 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270131 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270221 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270448 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270539 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270761 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.270905 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271073 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271160 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271391 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271484 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271705 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.271791 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272017 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272105 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272335 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272421 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272645 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272732 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.272969 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273059 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273279 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273363 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273621 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273766 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.273913 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274055 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274234 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274320 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274551 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274638 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274863 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.274983 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.275175 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.275271 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.275487 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.275573 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276060 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276151 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276386 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276479 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276682 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276763 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.276991 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277076 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277307 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277401 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277615 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277718 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.277965 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278051 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278272 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278370 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278592 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278677 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278903 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.278986 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.279215 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.279802 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280057 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280142 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280372 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280456 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280704 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.280791 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281019 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281112 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281336 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281421 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281665 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.281785 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282010 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282103 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282350 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282543 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282677 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.282934 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283027 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283262 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283349 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283616 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283739 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.283966 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284191 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284277 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284590 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284683 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284905 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.284993 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285236 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285322 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285556 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285656 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285900 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.285986 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286217 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286302 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286534 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286631 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286851 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.286937 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287170 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287255 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287487 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287573 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287804 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.287891 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288122 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288213 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288441 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288547 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288760 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.288856 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289082 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289168 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289405 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289502 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289743 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.289831 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290069 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290179 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290385 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290470 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290709 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.290794 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291025 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291119 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291342 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291428 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291661 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291754 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.291981 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292078 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292303 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292394 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292612 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292696 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.292930 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293037 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293258 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293350 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293602 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293738 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.293957 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.294044 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.294276 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.294362 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.294629 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.294715 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.295507 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.295607 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.295833 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.295918 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296162 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296260 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296480 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296566 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296819 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.296904 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297151 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297244 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297476 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297564 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297834 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.297922 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298150 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298252 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298462 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298548 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298773 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.298859 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299089 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299182 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299430 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299518 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299773 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.299865 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300088 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300173 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300406 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300499 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300721 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.300806 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301051 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301174 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301370 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301457 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301724 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.301850 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302059 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302159 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302378 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302463 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302693 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.302787 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303018 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303104 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303330 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303415 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303659 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303757 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.303978 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304064 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304295 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304379 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304607 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304701 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.304924 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305056 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305250 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305335 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305574 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305662 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305913 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.305998 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306229 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306325 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306552 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306639 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306875 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.306959 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307200 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307302 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307511 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307597 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307844 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.307935 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308161 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308248 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308481 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308574 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308800 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.308886 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309117 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309209 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309436 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309520 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309781 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.309871 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310106 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310203 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310429 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310514 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310772 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.310859 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311099 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311193 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311425 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311511 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311752 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.311836 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312087 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312173 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312425 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312512 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312748 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.312843 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.313067 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.313155 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.313380 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.313472 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.313630 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 03:49:15.313773 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.314117 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.314444 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.314767 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.315081 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:49:15.315332 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 03:49:15.336495 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.338301 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.404274 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.context [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b467d92-0504-42b7-a6ab-b2a53e25b100(cell1) {{(pid=101779) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 03:49:15.406323 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.context [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b467d92-0504-42b7-a6ab-b2a53e25b100(cell1) {{(pid=101778) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 03:49:15.408493 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:49:15.410125 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:49:15.410499 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:49:15.410974 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:49:15.412088 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:49:15.412905 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:49:15.413007 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:49:15.414876 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_concurrency.lockutils [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101778) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:49:15.425180 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.426317 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.428879 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.431063 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.595145 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_db.sqlalchemy.engines [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.597970 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG oslo_db.sqlalchemy.engines [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:49:15.936630 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:49:15.939358 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:49:15.943695 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:49:15.946069 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:49:16.287427 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:49:16.292738 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: WARNING keystonemiddleware.auth_token [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:49:16.296122 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:49:16.298506 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55602c9909c0 pid: 101778 (default app) Jan 11 03:49:16.300579 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:49:16.301418 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: WARNING keystonemiddleware.auth_token [None req-42e94c1e-8ea5-4b72-ab69-50799a1ea569 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:49:16.301768 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jan 11 03:49:16.302179 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Tue Jan 11 03:49:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:49:16.306574 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55602c9909c0 pid: 101779 (default app) Jan 11 03:50:42.722949 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:42.723972 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 11 03:50:42.724370 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:43.147319 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0bc107db-4580-443d-a790-4158f941c732 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:43.176599 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0bc107db-4580-443d-a790-4158f941c732 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444982 Jan 11 03:50:43.177249 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Jan 11 03:50:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:50:45.619171 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:45.621043 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-3791378b-a5bd-4586-96a9-b94837011f23 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003084 Jan 11 03:50:45.622064 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:45.688724 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-a48ecbb8-d36a-49ed-a202-f3d66cfd5803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "name": "cirros256"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:45.707174 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:50:45.707174 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:50:45.737964 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-a48ecbb8-d36a-49ed-a202-f3d66cfd5803 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110067 Jan 11 03:50:45.738657 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:50:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:50:45.986413 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6eb7666f-1917-42f1-bc18-03970df4a20d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:45.988904 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:50:45.988904 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Jan 11 03:50:46.037775 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6eb7666f-1917-42f1-bc18-03970df4a20d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290448 Jan 11 03:50:46.038568 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Jan 11 03:50:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:50:48.497030 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-a48ecbb8-d36a-49ed-a202-f3d66cfd5803 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:48.498092 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-a48ecbb8-d36a-49ed-a202-f3d66cfd5803 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 11 03:50:48.498514 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:48.631042 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-25d14e00-6b8a-42b9-99c0-c55ddf162974 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "name": "ds512M", "swap": 0}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:48.649315 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:50:48.649315 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: warnings.warn(msg) Jan 11 03:50:48.670093 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-25d14e00-6b8a-42b9-99c0-c55ddf162974 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165489 Jan 11 03:50:48.670761 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:50:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:50:48.682460 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c54ec56d-05e7-4e41-a634-7c28e3676575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:48.684492 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:50:48.684492 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:50:48.717197 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-c54ec56d-05e7-4e41-a634-7c28e3676575 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038317 Jan 11 03:50:48.717835 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Jan 11 03:50:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:50:51.142414 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-25d14e00-6b8a-42b9-99c0-c55ddf162974 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:51.143408 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-25d14e00-6b8a-42b9-99c0-c55ddf162974 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jan 11 03:50:51.143986 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:51.208500 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-f4508ae9-858f-4362-8f70-242cf802aaea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:51.228998 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-f4508ae9-858f-4362-8f70-242cf802aaea admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078950 Jan 11 03:50:51.230710 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:50:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:50:51.242351 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-2087a4f9-34b4-4f69-b7ea-6ecc7f78f4e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:51.267114 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-2087a4f9-34b4-4f69-b7ea-6ecc7f78f4e5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028568 Jan 11 03:50:51.267962 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Jan 11 03:50:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:50:53.730942 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-f4508ae9-858f-4362-8f70-242cf802aaea admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:53.731960 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-f4508ae9-858f-4362-8f70-242cf802aaea admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jan 11 03:50:53.732372 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:53.798413 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6615f67e-92bb-4466-99cc-21c2e25bf10b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "disk": 10, "id": "d3"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:53.822246 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6615f67e-92bb-4466-99cc-21c2e25bf10b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083675 Jan 11 03:50:53.822986 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:50:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:50:53.836354 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-e8a4f7e5-03c2-405a-b195-408b6c9e68fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:53.864119 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-e8a4f7e5-03c2-405a-b195-408b6c9e68fe admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031291 Jan 11 03:50:53.869913 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Jan 11 03:50:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:50:56.336908 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-6615f67e-92bb-4466-99cc-21c2e25bf10b admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:56.338032 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-6615f67e-92bb-4466-99cc-21c2e25bf10b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jan 11 03:50:56.338445 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:56.404041 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:56.427556 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081921 Jan 11 03:50:56.429038 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:50:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:50:56.441023 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-16552a6e-9081-4762-89b4-8e2a4f6f6552 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:50:56.466678 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-16552a6e-9081-4762-89b4-8e2a4f6f6552 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029232 Jan 11 03:50:56.467259 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Tue Jan 11 03:50:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:50:58.948667 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:58.949793 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jan 11 03:50:58.950232 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:50:59.011604 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-626abecd-a863-43eb-a2c9-7bed49a00710 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:50:59.036908 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-626abecd-a863-43eb-a2c9-7bed49a00710 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080433 Jan 11 03:50:59.037494 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Jan 11 03:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:01.495766 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:01.496837 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-94bd3d5e-a488-44d4-b215-ac0824cb3e9e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jan 11 03:51:01.497272 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:01.564092 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-8002e919-5208-4bc5-bd11-ea0d72b5a9f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:01.583394 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-8002e919-5208-4bc5-bd11-ea0d72b5a9f2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079648 Jan 11 03:51:01.584495 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:51:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:51:01.596837 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-db603637-c695-44bc-9af9-69318733e1f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:01.624898 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-db603637-c695-44bc-9af9-69318733e1f5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031890 Jan 11 03:51:01.625694 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Jan 11 03:51:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:51:04.079834 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-8002e919-5208-4bc5-bd11-ea0d72b5a9f2 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:04.080864 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-8002e919-5208-4bc5-bd11-ea0d72b5a9f2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jan 11 03:51:04.081272 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:04.138355 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-562992e4-7ca4-465f-9e9c-978d82db4158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:04.157463 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-562992e4-7ca4-465f-9e9c-978d82db4158 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070306 Jan 11 03:51:04.158049 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:51:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:51:04.169564 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5d19c7cb-0fe3-4273-a3f8-996763e70893 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:04.192191 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5d19c7cb-0fe3-4273-a3f8-996763e70893 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026351 Jan 11 03:51:04.193084 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Jan 11 03:51:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:51:06.614409 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-562992e4-7ca4-465f-9e9c-978d82db4158 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:06.615504 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-562992e4-7ca4-465f-9e9c-978d82db4158 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jan 11 03:51:06.615989 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:06.672072 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5c2fea29-df3a-4379-8945-07e85147d41f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:06.689508 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5c2fea29-df3a-4379-8945-07e85147d41f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067147 Jan 11 03:51:06.690104 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:51:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:51:06.702373 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-24b750a1-7cae-42cb-bf0f-20ec1ce1ec94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:06.724637 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-24b750a1-7cae-42cb-bf0f-20ec1ce1ec94 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026388 Jan 11 03:51:06.725210 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Jan 11 03:51:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:51:09.192670 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-5c2fea29-df3a-4379-8945-07e85147d41f admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:09.193609 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-5c2fea29-df3a-4379-8945-07e85147d41f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 11 03:51:09.194055 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:09.253341 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0262d2d8-1c3e-4259-a037-3bbc682642df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "vcpus": 4}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:09.270693 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0262d2d8-1c3e-4259-a037-3bbc682642df admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070936 Jan 11 03:51:09.271251 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:51:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:51:09.283483 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-07f50324-1c3e-4bea-81d7-0143422c990b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:09.310501 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-07f50324-1c3e-4bea-81d7-0143422c990b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030552 Jan 11 03:51:09.311332 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Jan 11 03:51:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:51:11.769831 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0262d2d8-1c3e-4259-a037-3bbc682642df admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:11.770858 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0262d2d8-1c3e-4259-a037-3bbc682642df admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jan 11 03:51:11.771268 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:11.831240 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:11.849612 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071743 Jan 11 03:51:11.850400 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Tue Jan 11 03:51:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:51:11.861809 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-6f299334-7b2e-4f4f-b047-65327e5f7666 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:11.886132 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-6f299334-7b2e-4f4f-b047-65327e5f7666 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027010 Jan 11 03:51:11.886810 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Tue Jan 11 03:51:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:51:32.948731 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:32.949822 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 11 03:51:32.950225 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:33.006262 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-2508f273-896c-4a79-9620-b2368a9816f2 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:33.022738 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-2508f273-896c-4a79-9620-b2368a9816f2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066716 Jan 11 03:51:33.023270 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Jan 11 03:51:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:34.647105 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:34.648109 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-273742d0-f80b-4106-9304-3d6fb2e9f746 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jan 11 03:51:34.648511 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:34.836849 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-97970e58-6a30-46cf-9e77-b2f4b5e89f3e admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:34.842458 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-97970e58-6a30-46cf-9e77-b2f4b5e89f3e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 03:51:34.843029 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-97970e58-6a30-46cf-9e77-b2f4b5e89f3e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:34.843819 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-97970e58-6a30-46cf-9e77-b2f4b5e89f3e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056900 Jan 11 03:51:34.844318 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Jan 11 03:51:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:34.853184 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-572f3c48-dcf7-4a10-8c50-3fb29534f16e admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:34.873818 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-572f3c48-dcf7-4a10-8c50-3fb29534f16e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023973 Jan 11 03:51:34.874222 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:34.883575 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-4491f9ef-03a9-4254-a00e-40226174616d admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:34.905469 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-4491f9ef-03a9-4254-a00e-40226174616d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025362 Jan 11 03:51:34.906193 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:34.915336 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c2f23983-7060-442b-adf5-e34c65e67df9 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:34.921040 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-c2f23983-7060-442b-adf5-e34c65e67df9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 11 03:51:34.921611 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-c2f23983-7060-442b-adf5-e34c65e67df9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:34.922434 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-c2f23983-7060-442b-adf5-e34c65e67df9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010681 Jan 11 03:51:34.922937 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Jan 11 03:51:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:36.435053 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-4491f9ef-03a9-4254-a00e-40226174616d admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:36.436096 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-4491f9ef-03a9-4254-a00e-40226174616d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jan 11 03:51:36.436498 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:36.626639 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-8c669932-d689-46e2-bc24-1be1f71130fb admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:36.632210 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-8c669932-d689-46e2-bc24-1be1f71130fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 03:51:36.632779 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-8c669932-d689-46e2-bc24-1be1f71130fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:36.633564 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-8c669932-d689-46e2-bc24-1be1f71130fb admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058274 Jan 11 03:51:36.634105 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Jan 11 03:51:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:36.643635 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-fd11b4de-cc15-47ef-b0f3-2e09da449cba admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:36.658629 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-fd11b4de-cc15-47ef-b0f3-2e09da449cba admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018409 Jan 11 03:51:36.659272 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 03:51:36.668332 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4397ad4f-f114-47d0-80d6-62488995f40d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:36.683380 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4397ad4f-f114-47d0-80d6-62488995f40d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018443 Jan 11 03:51:36.684247 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:36.692823 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff9283ac-d14b-4d84-ae03-06cbc721b169 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:36.698381 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-ff9283ac-d14b-4d84-ae03-06cbc721b169 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 11 03:51:36.698941 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-ff9283ac-d14b-4d84-ae03-06cbc721b169 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:36.699738 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-ff9283ac-d14b-4d84-ae03-06cbc721b169 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010240 Jan 11 03:51:36.700215 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Tue Jan 11 03:51:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:38.215096 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4397ad4f-f114-47d0-80d6-62488995f40d admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:38.216589 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4397ad4f-f114-47d0-80d6-62488995f40d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Jan 11 03:51:38.217243 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:38.406245 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-9bf94f46-f557-49d9-82a8-ebb8a8231e55 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:38.411472 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.wsgi [None req-9bf94f46-f557-49d9-82a8-ebb8a8231e55 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 03:51:38.412034 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-9bf94f46-f557-49d9-82a8-ebb8a8231e55 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:38.412809 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-9bf94f46-f557-49d9-82a8-ebb8a8231e55 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057277 Jan 11 03:51:38.413303 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:51:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:38.425733 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-4cee8f0c-021c-4a31-a0dd-0e8460f1693e admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:38.439913 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-4cee8f0c-021c-4a31-a0dd-0e8460f1693e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019509 Jan 11 03:51:38.440437 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:38.449877 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:38.462626 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016572 Jan 11 03:51:38.463136 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Tue Jan 11 03:51:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:51:38.471827 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d2e06065-3a27-4dc0-aa80-0ba1f5a3eb99 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:38.476876 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.wsgi [None req-d2e06065-3a27-4dc0-aa80-0ba1f5a3eb99 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 11 03:51:38.477436 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-d2e06065-3a27-4dc0-aa80-0ba1f5a3eb99 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101778) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:51:38.478788 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-d2e06065-3a27-4dc0-aa80-0ba1f5a3eb99 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009871 Jan 11 03:51:38.479269 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:51:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 11 03:51:40.005980 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:40.007016 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 11 03:51:40.007395 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:40.198270 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-befb92c4-cb87-49be-8d82-85ec3f8a4056 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:40.217088 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-befb92c4-cb87-49be-8d82-85ec3f8a4056 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070196 Jan 11 03:51:40.217739 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Jan 11 03:51:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:51:41.729810 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:41.730818 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 11 03:51:41.731232 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:41.922590 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-1c53dbc4-927c-4303-880c-cc778290364e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:41.940103 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-1c53dbc4-927c-4303-880c-cc778290364e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068635 Jan 11 03:51:41.940652 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Jan 11 03:51:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:51:43.454698 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:43.455709 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 11 03:51:43.456129 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:43.644784 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-ca9850be-5730-4caf-b224-47b144449674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:43.662904 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-ca9850be-5730-4caf-b224-47b144449674 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068554 Jan 11 03:51:43.663448 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Jan 11 03:51:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:51:45.174315 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:45.175273 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jan 11 03:51:45.175668 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:45.366877 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-37dafe51-17c7-4226-9951-dd62a2dddcdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:51:45.384183 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-37dafe51-17c7-4226-9951-dd62a2dddcdc admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068723 Jan 11 03:51:45.385361 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Tue Jan 11 03:51:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:51:46.890034 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:46.891156 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jan 11 03:51:46.891654 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:51:47.079126 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-e0cb0e8f-ff11-4344-a67a-274127b68b11 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:51:47.098226 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-e0cb0e8f-ff11-4344-a67a-274127b68b11 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069624 Jan 11 03:51:47.098766 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Tue Jan 11 03:51:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:52:35.347834 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.348835 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5593ea36-ba5c-4fc4-96af-e7fbe9cab381 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jan 11 03:52:35.349233 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:52:35.406113 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-9ed692cd-734a-483d-9aad-daa29d7ba5d7 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.426173 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-9ed692cd-734a-483d-9aad-daa29d7ba5d7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070510 Jan 11 03:52:35.426720 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:52:35.448620 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-59d411a9-dd4c-45cc-bd99-517b3b7a15ca admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.456247 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-59d411a9-dd4c-45cc-bd99-517b3b7a15ca admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011332 Jan 11 03:52:35.456762 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:52:35.467809 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-69f308fb-bfc0-4ddc-9c64-0587c0f71ea5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.475266 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-69f308fb-bfc0-4ddc-9c64-0587c0f71ea5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011028 Jan 11 03:52:35.475792 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:52:35.487098 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-c564616a-a2a5-4fc9-9ad0-3126d5adfd64 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.495168 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-c564616a-a2a5-4fc9-9ad0-3126d5adfd64 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011487 Jan 11 03:52:35.495682 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:52:35.506141 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:52:35.513499 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010655 Jan 11 03:52:35.514052 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Tue Jan 11 03:52:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:53:59.200084 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-dc6e615b-8ddf-417f-b20c-0f8ae0ed1f47 tempest-verify_tempest_config-1707692984 tempest-verify_tempest_config-1707692984-project] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:53:59.202101 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-dc6e615b-8ddf-417f-b20c-0f8ae0ed1f47 tempest-verify_tempest_config-1707692984 tempest-verify_tempest_config-1707692984-project] 10.222.0.24 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104581 Jan 11 03:53:59.202634 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 34/69] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Jan 11 03:53:59 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:55:25.562297 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:25.563306 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jan 11 03:55:25.563713 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 36/70] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:55:25.814719 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:25.816503 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:55:25.816503 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:55:25.818076 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:25.818522 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:25.819445 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:25.819875 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:25.852866 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-71679872-e47a-4366-9825-10ba148e81d7 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152289 Jan 11 03:55:25.853459 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 35/71] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:55:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:55:27.396366 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:27.397367 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jan 11 03:55:27.397792 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:55:27.588134 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:27.589303 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:55:27.589303 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:55:27.590891 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:27.591346 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:27.592155 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:27.592594 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:27.612208 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-5d82a79c-cbf4-45cd-b0e5-11c009d688fd admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074203 Jan 11 03:55:27.612689 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 36/73] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:55:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:55:39.557872 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:39.558877 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 11 03:55:39.559278 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:55:39.749010 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:39.750210 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:55:39.750210 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:55:39.751728 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:39.752181 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:39.753025 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:39.753464 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:39.778970 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-0b8b140b-54bd-4390-b96b-0b135726e625 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079645 Jan 11 03:55:39.779441 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 37/75] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:55:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:55:41.316322 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: DEBUG nova.api.openstack.wsgi [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] Calling method '>' {{(pid=101778) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:41.317354 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: INFO nova.api.openstack.requestlog [None req-48c734b8-275d-4547-8366-adb10340eff5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 11 03:55:41.317783 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: [pid: 101778|app: 0|req: 39/76] 10.222.0.24 () {56 vars in 1074 bytes} [Tue Jan 11 03:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:55:41.507370 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG nova.api.openstack.wsgi [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] Calling method '>' {{(pid=101779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:55:41.508515 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:55:41.508515 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: warnings.warn(msg) Jan 11 03:55:41.510038 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:41.510482 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:41.511267 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:55:41.511696 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: DEBUG oslo_concurrency.lockutils [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:55:41.533186 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: INFO nova.api.openstack.requestlog [None req-816e218b-c84a-448b-90bc-a7c86b7398a5 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076294 Jan 11 03:55:41.533653 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: [pid: 101779|app: 0|req: 38/77] 10.222.0.24 () {60 vars in 1193 bytes} [Tue Jan 11 03:55:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 03:56:40.053579 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: Tue Jan 11 03:56:40 2022 - graceful shutdown triggered... Jan 11 03:56:40.053742 dv-cinder-819778-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 11 03:56:40.054694 dv-cinder-819778-4-iscsi devstack@n-api.service[101778]: Gracefully killing worker 1 (pid: 101778)... Jan 11 03:56:40.055095 dv-cinder-819778-4-iscsi devstack@n-api.service[101779]: Gracefully killing worker 2 (pid: 101779)... Jan 11 03:56:41.055779 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: worker 1 buried after 1 seconds Jan 11 03:56:41.056333 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: worker 2 buried after 1 seconds Jan 11 03:56:41.056333 dv-cinder-819778-4-iscsi devstack@n-api.service[101777]: goodbye to uWSGI. Jan 11 03:56:41.057384 dv-cinder-819778-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 11 03:56:41.057980 dv-cinder-819778-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 11 03:56:41.060754 dv-cinder-819778-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 11 03:56:41.070948 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 11 03:56:41 2022] *** Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: nodename: dv-cinder-819778-4-iscsi Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: machine: x86_64 Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: clock source: unix Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: pcre jit disabled Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: detected number of CPU cores: 4 Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: current working directory: / Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: detected binary path: /usr/bin/uwsgi-core Jan 11 03:56:41.072945 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: your processes number limit is 47680 Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: your memory page size is 4096 bytes Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: detected max file descriptor number: 2048 Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: lock engine: pthread robust mutexes Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: thunder lock: enabled Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 11 03:56:41.073759 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 11 03:56:41.127622 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: Python main interpreter initialized at 0x5596552cf9c0 Jan 11 03:56:41.127622 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: python threads support enabled Jan 11 03:56:41.127622 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: your server socket listen backlog is limited to 100 connections Jan 11 03:56:41.127622 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: your mercy for graceful operations on workers is 90 seconds Jan 11 03:56:41.128081 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: mapped 403077 bytes (393 KB) for 2 cores Jan 11 03:56:41.128081 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: *** Operational MODE: preforking *** Jan 11 03:56:41.128333 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: *** uWSGI is running in multiple interpreter mode *** Jan 11 03:56:41.128333 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: spawned uWSGI master process (pid: 116368) Jan 11 03:56:41.128537 dv-cinder-819778-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 11 03:56:41.129089 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: spawned uWSGI worker 1 (pid: 116387, cores: 1) Jan 11 03:56:41.129664 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: spawned uWSGI worker 2 (pid: 116388, cores: 1) Jan 11 03:56:41.130059 dv-cinder-819778-4-iscsi devstack@n-api.service[116368]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 11 03:56:43.059443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:56:43.059443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: from cryptography.utils import int_from_bytes Jan 11 03:56:43.060139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:56:43.060139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: from cryptography.utils import int_from_bytes Jan 11 03:56:43.060267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:56:43.060267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: from cryptography.utils import int_from_bytes Jan 11 03:56:43.060708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 11 03:56:43.060708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: from cryptography.utils import int_from_bytes Jan 11 03:56:45.465517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 03:56:45.466092 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 03:56:45.466356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 03:56:45.466730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 03:56:45.466992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 03:56:45.467392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.467782 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.468118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.468444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.468783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.469101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.469430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.469777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.470114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.470897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.471221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.471553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-4-iscsi {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.471911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.472198 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.472517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.472770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 11 03:56:45.473211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.473306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 11 03:56:45.473417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.473502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.473588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 11 03:56:45.473830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.473960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 11 03:56:45.474171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 11 03:56:45.474362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.474573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.474819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.474924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.475949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476167 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.476925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477131 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477220 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.477852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819778-4-iscsi {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-4-iscsi {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.478841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479065 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479393 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.479931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.480930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.481926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482578 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.482890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.483846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484582 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819778-4-iscsi {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484707 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.484808 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.485992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.486695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.486788 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.486946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487524 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487690 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.487856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488008 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.488808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489653 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489775 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.489994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490172 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.490967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491280 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.491955 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.492958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493724 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.493871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494219 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494522 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.494841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495003 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495318 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.495946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.496881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497664 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.497948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498041 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498280 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.498912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499640 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.499960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.500906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.501892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502456 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.502861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.503975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.504923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505324 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.505999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.506932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507252 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.507924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508402 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508716 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.508806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.509986 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.510925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511253 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.511979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512193 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.512916 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.513152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.513241 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.513463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.513560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.513803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.513909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.514134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.514222 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.514450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.514549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.514764 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.514854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.515077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.515166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.515389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.515479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.515701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.515790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.516014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.516113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.516325 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.516422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.516636 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.516725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.516946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.517035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.517300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.517409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.517629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.517740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.517980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.518070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.518296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.518387 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.518610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.518699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.518929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.519024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 11 03:56:45.519256 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.519346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.519594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.519691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.519928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520034 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.520941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521049 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.521928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.522984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523313 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523633 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.523964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524184 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524280 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524599 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.524984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.525926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526458 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.526883 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.527101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.527201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.527692 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.527803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528004 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528662 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.528983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529743 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.529959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530595 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.530920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531024 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531557 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.531994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.532201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.532347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.532521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.532633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.533332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.533429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.533665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.533817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534353 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.534972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.535195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.535310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.535619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.535715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.535960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.536163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.536279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.536612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.536715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.536947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.537090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.537273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.537543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.537653 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.537918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.538035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.538234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.538534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.538637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.538847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.539873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540503 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.540821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541148 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.541828 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.542992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543312 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543634 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.543977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544312 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.544947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545585 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.545925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.546971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547570 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547672 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547816 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.547904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.548131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.548221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.548465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.548590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.549376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.549518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.549610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.549726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.549952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.550909 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551001 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551569 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551884 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.551972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552839 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.552928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.553937 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554789 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.554877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.555832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556159 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556388 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556714 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.556823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.557824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.558957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.559919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560339 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560653 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.560974 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561182 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561496 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.561951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562787 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.562882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563197 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563738 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.563832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564064 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.564844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565041 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565148 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565444 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.565849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.566962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567272 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567698 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.567910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.568951 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569271 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569584 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.569927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.570990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571432 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.571979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.572941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573659 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.573997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574870 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.574958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.575989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.576884 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.577944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.578996 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.579088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.579311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.579408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.579625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.580270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.580462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.580564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.580783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.580872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.581853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.582075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.582177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.582408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.582658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.582755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583001 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.583963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.584967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585288 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.585955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586095 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586351 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.586990 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.587967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588148 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588241 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.588857 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.589839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.590986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.591921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.592960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593263 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593589 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593835 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.593939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594148 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.594907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.595105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.595228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.596866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.596965 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.596965 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597135 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.597959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598107 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598448 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598531 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598692 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.598949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.599959 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600054 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.600996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601212 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601528 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601865 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.601968 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602272 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.602903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.603837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604364 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.604810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605143 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.605987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606299 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.606926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607071 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607575 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.607967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608490 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608579 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.608890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609116 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.609929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610367 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.610770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611445 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.611877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612349 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612516 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612746 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.612976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613298 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613410 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.613962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614673 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.614902 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.615940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.616894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617108 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617198 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617509 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.617852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.618838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619141 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619383 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.619887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.620967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.621952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622080 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622590 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.622998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.623220 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.623321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.623536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.623634 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.623850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624204 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.624869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625368 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.625887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626213 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.626980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627300 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.627927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.628898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629223 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.629975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.630884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631212 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631747 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.631838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632392 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.632831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633016 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.633876 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.634852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635168 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.635821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636349 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636668 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.636986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637303 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.637957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.638179 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.638403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.638567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.638814 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.638957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639107 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639244 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639481 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639620 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.639908 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640312 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640788 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.640879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641423 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.641930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.642109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.642786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.642953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.643123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.643283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.643478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.643670 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.643838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644014 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644682 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.644839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645016 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.645967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646282 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646692 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.646907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647004 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647531 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647844 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.647939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.648912 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649097 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.649882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.650776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651410 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651746 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.651975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.652064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.652319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.652669 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.652887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.652976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653222 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.653987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.654971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655503 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655816 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.655924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656539 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.656851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657374 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.657811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.658590 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.658828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.658954 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659320 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659846 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.659987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660343 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.660915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661352 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.661973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.662973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663317 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.663964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664376 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.664929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665252 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.665923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.666174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.666273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.666507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.666612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.666837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667448 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.667871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668737 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.668852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.669812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670141 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670456 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670684 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.670783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.671865 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.672969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.673207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.673299 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.673562 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.673725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.673909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.674966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675194 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675511 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.675929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676148 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.676881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.677994 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.678168 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.678356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.678452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.678685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.678897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679125 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679687 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.679882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680004 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680339 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.680986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.681220 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.681311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.681550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.681641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.681899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682213 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.682946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.683870 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.684820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685467 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.685944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686622 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686730 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.686945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687258 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687688 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.687990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688524 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.688952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.689918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690278 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690788 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.690893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691437 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.691843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692086 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.692961 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693789 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.693982 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694707 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.694929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695242 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.695973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696289 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.696928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.697898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.698103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.698194 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.698917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.699778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.700967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.701269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.701361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.701587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.701713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.701937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702029 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.702918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.703879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.704003 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.704197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.704332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.704514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.704651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.705370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.705539 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.705703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.705897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706026 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706640 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.706962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707555 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.707996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708846 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.708945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709159 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709578 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709810 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.709903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.710934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711204 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711512 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.711862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.712843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713157 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713405 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713746 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.713855 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714071 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.714793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715672 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.715770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716707 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.716929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717032 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.717919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718342 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718883 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.718976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719199 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719516 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.719975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.720173 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.720366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.720547 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.720662 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.720864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721204 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.721921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722242 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722666 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.722970 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.723953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.724109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 03:56:45.724199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.724492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.724817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.725144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.725464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.725801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.726140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.726456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.726775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.727094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.727413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.727738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.728062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.728395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.728731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.729065 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.729400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.729775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.730098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.730452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.730785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.731106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.731424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.731738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 11 03:56:45.731991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 11 03:56:45.747144 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_db.sqlalchemy.engines [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:45.755233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_db.sqlalchemy.engines [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:45.816439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.context [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b467d92-0504-42b7-a6ab-b2a53e25b100(cell1) {{(pid=116388) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 03:56:45.820836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:56:45.822513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:56:45.823347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:56:45.823512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.context [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b467d92-0504-42b7-a6ab-b2a53e25b100(cell1) {{(pid=116387) load_cells /opt/stack/nova/nova/context.py:464}} Jan 11 03:56:45.825289 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:56:45.827800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:56:45.829425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:56:45.830334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:56:45.832302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:56:45.837540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_db.sqlalchemy.engines [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:45.838248 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_db.sqlalchemy.engines [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:45.843148 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_db.sqlalchemy.engines [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:45.844732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_db.sqlalchemy.engines [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:46.009502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_db.sqlalchemy.engines [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:46.012179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_db.sqlalchemy.engines [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 11 03:56:46.337389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: WARNING keystonemiddleware.auth_token [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:56:46.337871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: WARNING keystonemiddleware.auth_token [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:56:46.344134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: WARNING keystonemiddleware.auth_token [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:56:46.344510 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: WARNING keystonemiddleware.auth_token [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:56:46.687626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: WARNING keystonemiddleware.auth_token [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:56:46.688678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: WARNING keystonemiddleware.auth_token [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 11 03:56:46.693350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: WARNING keystonemiddleware.auth_token [None req-250dc7aa-9a5b-46d5-855f-eb9d3b5f1117 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:56:46.694511 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: WARNING keystonemiddleware.auth_token [None req-dbab0774-e648-4e6e-bd7e-a30d5cc5b0a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 11 03:56:46.698737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596552cf9c0 pid: 116387 (default app) Jan 11 03:56:46.699829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596552cf9c0 pid: 116388 (default app) Jan 11 03:57:20.001090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2a8e7c75-2b70-4291-ba7a-42da226f9481 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Action: 'create', calling method: .version_select at 0x7f4e67821a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1814269988"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:21.460933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b4dff4b9-8588-4387-9843-501ea276a042 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Action: 'create', calling method: .version_select at 0x7f4e67822a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-888841392", "metadata": {"Type": "work"}}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:21.979555 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2a8e7c75-2b70-4291-ba7a-42da226f9481 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.049961 Jan 11 03:57:21.980201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1154 bytes} [Tue Jan 11 03:57:18 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3052 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 03:57:22.289531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1089900797", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "7c3b392c-7bdf-40a2-b1a9-2f3039d2829a"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:22.463123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] validate_networks() for [('7c3b392c-7bdf-40a2-b1a9-2f3039d2829a', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:57:23.275781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b4dff4b9-8588-4387-9843-501ea276a042 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.208212 Jan 11 03:57:23.275781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 1/2] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Jan 11 03:57:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3211 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 11 03:57:23.561404 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2034098099", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "087faa05-11e7-4fe5-9a10-0975a8f10a51"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:23.696722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] validate_networks() for [('087faa05-11e7-4fe5-9a10-0975a8f10a51', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:57:23.696846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:57:23.696846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:57:23.696846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:57:23.696846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:57:23.696846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:57:23.739088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:23.739549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:23.742814 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:23.743264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:23.825490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:57:23.856834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for user 4dcd5f80a739403ab7577cc398ba0754 and project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:57:23.905928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:57:23.931248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:57:24.127823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-023529a8-434f-48db-98d5-44a2a3f753e7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140283 Jan 11 03:57:24.129313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 2/3] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:57:24.136315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3b3bda76-8310-4077-9d5a-cc8ae8a7ca93 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e675fcd30>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:24.258038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3b3bda76-8310-4077-9d5a-cc8ae8a7ca93 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 346 microversion: 2.1 time: 0.125859 Jan 11 03:57:24.268290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:24 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:24.275874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-365fb3b3-1308-4e07-8b01-caa4ee9bd54a tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e6760f940>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:24.364738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-365fb3b3-1308-4e07-8b01-caa4ee9bd54a tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 353 microversion: 2.1 time: 0.093786 Jan 11 03:57:24.382528 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 4/5] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:24 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:24.394019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5ca38bf8-f6a1-47ed-8e29-231a3cbe2103 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:24.399370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5ca38bf8-f6a1-47ed-8e29-231a3cbe2103 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:24.517128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5ca38bf8-f6a1-47ed-8e29-231a3cbe2103 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:24.544222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5ca38bf8-f6a1-47ed-8e29-231a3cbe2103 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1218 microversion: 2.1 time: 0.160115 Jan 11 03:57:24.545348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 5/6] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:24 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:24.551901 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e82a6208-f3a4-4ec3-8b60-1cab4eb35899 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Action: 'create', calling method: .version_select at 0x7f4e665a98b0>, body: {"snapshot": {"volume_id": "de2cc53b-1a8b-418c-8224-409a9b79ef9f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-54439995"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:24.938680 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e82a6208-f3a4-4ec3-8b60-1cab4eb35899 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.391498 Jan 11 03:57:24.953938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 6/7] 10.222.0.24 () {60 vars in 1161 bytes} [Tue Jan 11 03:57:24 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:24.953938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c56cb49f-ec98-41c8-885c-54c484666ea3 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665a9ee0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.082752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c56cb49f-ec98-41c8-885c-54c484666ea3 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 353 microversion: 2.1 time: 0.141480 Jan 11 03:57:25.096342 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 7/8] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:24 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:25.124084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6855d4a7-a929-4cfb-a52c-9f83875fd566 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665bc700>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.184159 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6855d4a7-a929-4cfb-a52c-9f83875fd566 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.085862 Jan 11 03:57:25.185370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 8/9] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:25.190614 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-955a59b0-9c6e-4a76-8fa3-c0459f69badf tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665c8280>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.212973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:57:25.213515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:57:25.214198 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:57:25.214695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:57:25.215044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:57:25.258464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:25.258928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:25.259762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:25.260179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:25.288066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-955a59b0-9c6e-4a76-8fa3-c0459f69badf tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 202 len: 0 microversion: 2.1 time: 0.100291 Jan 11 03:57:25.288910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 03:57:25 2022] DELETE /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 03:57:25.298121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8b45588d-8c62-42e8-ac63-c678dd03f3bb tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665bcd30>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.371020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8b45588d-8c62-42e8-ac63-c678dd03f3bb tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.077891 Jan 11 03:57:25.372701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 10/11] 10.222.0.24 () {58 vars in 1139 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:25.378592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-de1e67e1-cde6-4bb1-aa2f-9a7665bd4363 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e6760fd30>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.383741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Getting quotas for project 10880d10cb47487ab3ae887456176c6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:57:25.400764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Getting quotas for user 71e5c520f83547d99176925eff449676 and project 10880d10cb47487ab3ae887456176c6c. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:57:25.431831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:57:25.438412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:57:25.444297 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-de1e67e1-cde6-4bb1-aa2f-9a7665bd4363 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.069676 Jan 11 03:57:25.451651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 11/12] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:25.458446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2350841d-a134-4d75-aa03-15ff3f22eae1 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665c80d0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.498417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2350841d-a134-4d75-aa03-15ff3f22eae1 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.045012 Jan 11 03:57:25.499724 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 12/13] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:25.566329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-61464165-ed1b-4c42-bb0e-5f0e14e90e66 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.567613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-61464165-ed1b-4c42-bb0e-5f0e14e90e66 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:25.654646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-40a8335b-7076-4ce5-a941-c180056e6d7c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391092 Jan 11 03:57:25.660651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 2/14] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:57:25.665932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-06c5cbc1-9a84-4ff4-8726-9661af95023d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:25.666554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-06c5cbc1-9a84-4ff4-8726-9661af95023d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:25.731942 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-61464165-ed1b-4c42-bb0e-5f0e14e90e66 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:25.751757 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-61464165-ed1b-4c42-bb0e-5f0e14e90e66 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1218 microversion: 2.1 time: 0.181831 Jan 11 03:57:25.764269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 13/15] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:25.879881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-06c5cbc1-9a84-4ff4-8726-9661af95023d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:25.950261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-06c5cbc1-9a84-4ff4-8726-9661af95023d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1215 microversion: 2.1 time: 0.288108 Jan 11 03:57:25.957061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 3/16] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:25 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:26.459518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a3f7bd7a-e6a6-4d5a-a75d-e19e023ee6a3 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665c84c0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:26.510521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-533f25c8-6873-4cb8-a664-c773414783b8 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e675fed30>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:26.569301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-533f25c8-6873-4cb8-a664-c773414783b8 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.062355 Jan 11 03:57:26.570165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 4/17] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:26 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:57:26.574745 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a3f7bd7a-e6a6-4d5a-a75d-e19e023ee6a3 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.120329 Jan 11 03:57:26.575774 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 14/18] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:26 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:26.780411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:26.781031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:26.792819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:26.793288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:26.797638 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:26.798133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:26.974676 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:26.975355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:26.988385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:26.988891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:26.989886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:26.990509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:27.192345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:27.214988 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4299eb08-ee74-4ab6-a7fb-d662b12458b2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1222 microversion: 2.1 time: 0.438323 Jan 11 03:57:27.215993 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 5/19] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:26 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1222 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:27.251575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:27.271516 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a1f0bcbc-1331-42f0-9384-cbca5530cbd2 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1219 microversion: 2.1 time: 0.299539 Jan 11 03:57:27.272407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 15/20] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:26 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:27.588987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b31f6c6d-fa70-4f47-8f4f-a2e0e3479086 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665370d0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:27.591508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-988a66fe-e19d-4cf0-b51b-acf962ef2ea4 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665360d0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:27.676472 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b31f6c6d-fa70-4f47-8f4f-a2e0e3479086 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.092022 Jan 11 03:57:27.677274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 16/21] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:27 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:57:27.908653 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-988a66fe-e19d-4cf0-b51b-acf962ef2ea4 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.330760 Jan 11 03:57:27.909279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 6/22] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:27 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:28.244234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:28.244776 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:28.270569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:28.271214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:28.272203 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:28.272820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:28.288813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:28.289783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:28.306670 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:28.307315 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:28.308574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:28.309348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:28.383114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:28.392136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2ff1dfa0-3337-4b8e-a636-fb1d9233b652 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1222 microversion: 2.1 time: 0.154882 Jan 11 03:57:28.405888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 17/23] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:28 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:28.430891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:28.446740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-394b0d74-c996-4476-b7bf-519293f841e1 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1219 microversion: 2.1 time: 0.161894 Jan 11 03:57:28.456948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 7/24] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:28 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:28.689938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-25a94d3d-5be3-4f92-9460-e12169ab4801 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665299d0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:28.754886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-25a94d3d-5be3-4f92-9460-e12169ab4801 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.069736 Jan 11 03:57:28.756063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 18/25] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:28 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:28.921353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-43cd5009-2b5e-41cc-bfa4-831a08b2826e tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665bc4c0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:28.957451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-43cd5009-2b5e-41cc-bfa4-831a08b2826e tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.040953 Jan 11 03:57:28.958167 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 19/26] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:28 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:29.120566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: .version_select at 0x7f4e6808a160>, body: {"keypair": {"name": "tempest-keypair-1729144308"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:29.144138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:57:29.148013 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:57:29.419855 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:29.420521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:29.431087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:29.433633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:29.435916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:29.437275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:29.502207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:57:29.506426 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:57:29.515170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:29.521834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-458d3c53-b16e-426b-bfb4-f56b624698be tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.670536 Jan 11 03:57:29.525734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 8/27] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Jan 11 03:57:28 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:29.526436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-42ff11f6-fb3e-4b4d-a62a-2cd3b421862f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1222 microversion: 2.1 time: 0.117257 Jan 11 03:57:29.526436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 20/28] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:29 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:29.540023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:29.540992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:29.568556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:29.575683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:29.576974 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:29.577665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:29.673858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:29.673858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d989831a-5e07-454b-a124-3e18b25e0798 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1219 microversion: 2.1 time: 0.137461 Jan 11 03:57:29.673858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 9/29] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:29 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:29.766717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fc2ba89e-e978-4bd2-a103-c979136df7ec tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e66545940>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:29.878235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fc2ba89e-e978-4bd2-a103-c979136df7ec tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.115227 Jan 11 03:57:29.879073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 21/30] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:29 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:29.968335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c3a6c6d4-26bb-4922-b420-d12712c7e808 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e664e6670>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:30.023198 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c3a6c6d4-26bb-4922-b420-d12712c7e808 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.058457 Jan 11 03:57:30.023971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 10/31] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:29 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:30.541612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:30.542272 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:30.552530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:30.553054 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:30.557975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:30.558576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:30.642236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:30.657064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6aa1b898-82be-45f8-848e-0d5045614eb9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1222 microversion: 2.1 time: 0.118266 Jan 11 03:57:30.657900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 22/32] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:30 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:30.688087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:30.690938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:30.706325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:30.709015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:30.711866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:30.714284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:30.837281 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:30.847905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-883be16b-943f-4cab-a4e3-6c8ba5154b0e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1219 microversion: 2.1 time: 0.170044 Jan 11 03:57:30.850840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 11/33] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:30 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:30.891406 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ea50445c-9e26-4f58-a8dc-cb26f584eaba tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e665c8dc0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:30.975942 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ea50445c-9e26-4f58-a8dc-cb26f584eaba tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 200 len: 352 microversion: 2.1 time: 0.088691 Jan 11 03:57:30.977012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 23/34] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:30 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:31.040663 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-23c3fb71-2e25-4301-9afd-cb327c7e4ed7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e664e6dc0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:31.094462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-23c3fb71-2e25-4301-9afd-cb327c7e4ed7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.060975 Jan 11 03:57:31.095054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 12/35] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:31 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:31.675532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:31.676323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:31.699938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:31.700669 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:31.702610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:31.703769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:31.867579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:31.868444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:31.881116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:31.881581 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:31.894068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:31.894597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:31.899738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:31.912076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-49f78e1d-0d4e-499e-8756-31c38b7a56a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1270 microversion: 2.1 time: 0.238186 Jan 11 03:57:31.916485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 24/36] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:31 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:31.989457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-92aa8f28-947f-4583-86f9-bd49116ce605 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Calling method '.version_select at 0x7f4e66529c10>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:32.061720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-92aa8f28-947f-4583-86f9-bd49116ce605 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] HTTP exception thrown: Volume beca2f9b-8808-4422-88d6-5f67e21fd28c could not be found. Jan 11 03:57:32.065109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-92aa8f28-947f-4583-86f9-bd49116ce605 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] Returning 404 to user: Volume beca2f9b-8808-4422-88d6-5f67e21fd28c could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:32.066598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-92aa8f28-947f-4583-86f9-bd49116ce605 tempest-VolumesGetTestJSON-1094738270 tempest-VolumesGetTestJSON-1094738270-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c" status: 404 len: 109 microversion: 2.1 time: 0.082078 Jan 11 03:57:32.067353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 25/37] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:31 2022] GET /compute/v2.1/os-volumes/beca2f9b-8808-4422-88d6-5f67e21fd28c => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:32.107286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-19734580-cd05-4280-aca1-6be936c871a1 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e66545820>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:32.158719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-19734580-cd05-4280-aca1-6be936c871a1 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 286 microversion: 2.1 time: 0.055385 Jan 11 03:57:32.161996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 26/38] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:32 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:32.173544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7d05c2a6-b214-48e1-a829-752178b8ad5e tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665c80d0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:32.175494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:32.183948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1d9f82ef-b67b-4636-9739-7f71b18c69da tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1267 microversion: 2.1 time: 0.321180 Jan 11 03:57:32.192782 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 13/39] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:31 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:32.303563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7d05c2a6-b214-48e1-a829-752178b8ad5e tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 202 len: 0 microversion: 2.1 time: 0.135137 Jan 11 03:57:32.308070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 27/40] 10.222.0.24 () {58 vars in 1253 bytes} [Tue Jan 11 03:57:32 2022] DELETE /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 03:57:32.315020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7e35b2f5-0683-4655-bbe1-6c09fb4af410 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ca5550>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:32.381937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7e35b2f5-0683-4655-bbe1-6c09fb4af410 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 200 len: 285 microversion: 2.1 time: 0.072351 Jan 11 03:57:32.382929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 14/41] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:32 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 285 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:32.716761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-318635593", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ee679d6-2a6c-49a4-a892-76737d07cced"}], "security_groups": [{"name": "tempest-securitygroup--738412742"}], "key_name": "tempest-keypair-1729144308", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:32.933402 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:32.934046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:32.944647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:32.945363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:32.949461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:32.950109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:33.071709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] validate_networks() for [('7ee679d6-2a6c-49a4-a892-76737d07cced', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:57:33.280027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:33.290158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ed8e7ecd-4be7-478e-abc8-822603b683c1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1276 microversion: 2.1 time: 0.360246 Jan 11 03:57:33.294204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 15/42] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:32 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1276 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:33.308322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:33.309750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:33.325475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:33.326214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:33.327162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:33.327745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:33.656128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:33.670617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-52bd9505-071a-44f6-b08e-0cf71646f621 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1273 microversion: 2.1 time: 0.375091 Jan 11 03:57:33.672361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 16/43] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:33 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:33.687069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4beb1ca-2a66-4792-9b16-9d103baca1c9 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ccd1f0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:33.762110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-a4beb1ca-2a66-4792-9b16-9d103baca1c9 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] HTTP exception thrown: Snapshot 51248f3b-1054-4474-bd2e-b855204177f1 could not be found. Jan 11 03:57:33.762924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4beb1ca-2a66-4792-9b16-9d103baca1c9 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Returning 404 to user: Snapshot 51248f3b-1054-4474-bd2e-b855204177f1 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:33.768765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a4beb1ca-2a66-4792-9b16-9d103baca1c9 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1" status: 404 len: 111 microversion: 2.1 time: 0.093416 Jan 11 03:57:33.770016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 17/44] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 03:57:33 2022] GET /compute/v2.1/os-snapshots/51248f3b-1054-4474-bd2e-b855204177f1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:33.796522 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-08a5107a-6fe3-4b5d-adcc-4d689b1c8480 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e680d2ca0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:34.041385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-08a5107a-6fe3-4b5d-adcc-4d689b1c8480 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 202 len: 0 microversion: 2.1 time: 0.262098 Jan 11 03:57:34.041385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 18/45] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 03:57:33 2022] DELETE /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 03:57:34.049571 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4f3ef5eb-8348-46de-b057-894c890ee7b7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ccd670>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:34.200617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4f3ef5eb-8348-46de-b057-894c890ee7b7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 345 microversion: 2.1 time: 0.155746 Jan 11 03:57:34.201757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 19/46] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:34 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:34.313167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:34.314280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:34.323855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:34.324736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:34.330760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:34.331411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:34.874749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:34.906937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-73270b3c-5e35-4449-9986-01e1cf1846ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1276 microversion: 2.1 time: 0.596542 Jan 11 03:57:34.927095 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 20/47] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:34 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1276 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:34.944249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:34.947084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:34.965538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:34.968398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:34.972023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:34.973506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:35.763942 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:57:35.764484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:57:35.766530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:57:35.767199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:57:35.767800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:57:35.780593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:35.784964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:35.786950 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:35.788507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:35.789121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:35.818386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-37086bc2-a271-4aaf-acae-0c6eb2c40f31 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.887845 Jan 11 03:57:35.822911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 21/48] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:34 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:35.831658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c68a5ef0-064d-4dfe-abc7-4ef0904c4a7d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e66545670>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:35.844260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:57:35.864323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:57:35.879925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:57:35.882239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:57:35.929771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c68a5ef0-064d-4dfe-abc7-4ef0904c4a7d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 345 microversion: 2.1 time: 0.105259 Jan 11 03:57:35.930362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 22/49] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:35 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:35.939199 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:35.940232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:35.957818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:35.960533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:35.962673 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:35.963964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:36.046219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-04034eed-a072-40e1-b273-654879e99b58 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.335058 Jan 11 03:57:36.063095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 28/50] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:57:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 3352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:57:36.080275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dcfdf811-4aca-4a0b-83bc-902412976e96 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:36.080902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dcfdf811-4aca-4a0b-83bc-902412976e96 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:36.474096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-dcfdf811-4aca-4a0b-83bc-902412976e96 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:36.492967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dcfdf811-4aca-4a0b-83bc-902412976e96 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1237 microversion: 2.1 time: 0.426486 Jan 11 03:57:36.493818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 29/51] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:36 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1237 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:36.520826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:36.530785 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d5caf973-c3af-41e1-9018-e708e2463c10 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.595835 Jan 11 03:57:36.531984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 23/52] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:35 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:36.845507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:36.846238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:36.855312 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:36.855783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:36.856570 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:36.857164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:36.943450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-77ef4fa8-8578-4d02-adb8-c730df1f4ee7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ca58b0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:37.006001 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-77ef4fa8-8578-4d02-adb8-c730df1f4ee7 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 345 microversion: 2.1 time: 0.066555 Jan 11 03:57:37.011474 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 24/53] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:36 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:37.037318 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:37.051926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-42010332-b961-4148-88d3-e22f5491f65e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.216509 Jan 11 03:57:37.062022 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 30/54] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:36 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:37.512276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:37.513722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:37.525845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:37.527386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:37.530814 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:37.532662 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:37.549287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:37.549824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:37.562065 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:37.564115 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:37.566655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:37.568537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:37.691440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:37.701327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bad45951-13f6-4cf7-af17-65be2e8a321a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1241 microversion: 2.1 time: 0.193380 Jan 11 03:57:37.703242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 25/55] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:37 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:37.764587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:37.774633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d4e672a6-822d-4cbb-858b-eb2f2c1f67ba tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.230445 Jan 11 03:57:37.775382 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 31/56] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:37 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:38.018803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-17c3fc1a-c552-4902-97cf-cbf61c6081d4 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ccd700>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:38.071031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:38.072504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:38.081920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.082680 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.083633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.084217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.106255 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-17c3fc1a-c552-4902-97cf-cbf61c6081d4 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 345 microversion: 2.1 time: 0.091510 Jan 11 03:57:38.106910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 26/57] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:38 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:38.281767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:38.291479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-717048da-3da6-4192-afc8-94a25c918f29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.225726 Jan 11 03:57:38.296154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 32/58] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:38 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:38.719939 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:38.720815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:38.734962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.738375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.739715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.740774 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.796171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:38.797697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:38.812212 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.815645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.818713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:38.819459 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:38.852021 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:38.864279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-644c421a-6c98-4608-baae-d9b2dad772d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1241 microversion: 2.1 time: 0.145071 Jan 11 03:57:38.866432 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 27/59] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:38 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:39.095190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:39.109215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-42877a30-ffba-4592-86df-406342a51c70 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.320365 Jan 11 03:57:39.124206 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 33/60] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:38 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:39.144323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d7da09fa-edba-487c-a2e6-e77f26c807f2 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65cb6550>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:39.233791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d7da09fa-edba-487c-a2e6-e77f26c807f2 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 200 len: 345 microversion: 2.1 time: 0.116144 Jan 11 03:57:39.235040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 28/61] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:39 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:39.313514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:39.314236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:39.325872 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:39.326341 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:39.327466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:39.327938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:39.604568 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:39.626458 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-06aac37c-9cd2-4ec4-8d7e-421bf95f1b29 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.316849 Jan 11 03:57:39.627824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 34/62] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:39 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:39.884547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:39.884547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:39.892763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:39.893230 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:39.894591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:39.895048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:40.005207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:40.019459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-13b323f6-7d7e-4b09-a91f-bdeeff089b07 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1241 microversion: 2.1 time: 0.139510 Jan 11 03:57:40.025783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 29/63] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:39 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:40.127782 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:40.128966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:40.138734 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:40.140983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:40.142472 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:40.146127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:40.248547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eaa8da19-31de-4886-937b-8b81db694646 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e665459d0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:40.322029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-eaa8da19-31de-4886-937b-8b81db694646 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] HTTP exception thrown: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. Jan 11 03:57:40.322629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eaa8da19-31de-4886-937b-8b81db694646 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Returning 404 to user: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:40.323637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eaa8da19-31de-4886-937b-8b81db694646 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 404 len: 109 microversion: 2.1 time: 0.079727 Jan 11 03:57:40.332972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 30/64] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:40 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:40.337827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-46e66010-0824-4f44-82a0-63c9a17dbb43 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e65ca50d0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:40.439768 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-46e66010-0824-4f44-82a0-63c9a17dbb43 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] HTTP exception thrown: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. Jan 11 03:57:40.440933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-46e66010-0824-4f44-82a0-63c9a17dbb43 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Returning 404 to user: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:40.441695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:40.442935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-46e66010-0824-4f44-82a0-63c9a17dbb43 tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 404 len: 109 microversion: 2.1 time: 0.108733 Jan 11 03:57:40.447228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 31/65] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 03:57:40 2022] DELETE /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:40.452819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0163763f-e3df-49c2-8d00-dee0b573d73d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Calling method '.version_select at 0x7f4e66536af0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:40.454132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-30a16034-0c4b-4d7f-a0fa-294cb13f6131 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.329698 Jan 11 03:57:40.462789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 35/66] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:40 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:40.493301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-0163763f-e3df-49c2-8d00-dee0b573d73d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] HTTP exception thrown: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. Jan 11 03:57:40.493936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0163763f-e3df-49c2-8d00-dee0b573d73d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] Returning 404 to user: Volume de2cc53b-1a8b-418c-8224-409a9b79ef9f could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:40.494816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0163763f-e3df-49c2-8d00-dee0b573d73d tempest-VolumesSnapshotsTestJSON-188814393 tempest-VolumesSnapshotsTestJSON-188814393-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f" status: 404 len: 109 microversion: 2.1 time: 0.046340 Jan 11 03:57:40.501431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 32/67] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:40 2022] GET /compute/v2.1/os-volumes/de2cc53b-1a8b-418c-8224-409a9b79ef9f => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:40.662972 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:40.664750 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:40.677093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:40.677736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:40.678854 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:40.679428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:41.053727 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:41.056436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:41.071371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:41.080299 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:41.088714 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:41.090695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:41.091699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-828f7dd6-82ba-45e6-b970-e071556d93c9 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.450748 Jan 11 03:57:41.092333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:41.097808 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 36/68] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:40 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:41.341658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:41.363551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-23967d80-b369-4d31-bcdb-7a5dbc91e5c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1241 microversion: 2.1 time: 0.323865 Jan 11 03:57:41.366381 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 33/69] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:41 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1241 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:41.473127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:41.474091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:41.484233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:41.487358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:41.488353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:41.490050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:41.998527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:42.031799 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-77bec026-22ad-4f8d-8f55-a27da1ba3a89 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.563092 Jan 11 03:57:42.034217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 37/70] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:41 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:42.117616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:42.118514 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:42.141989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:42.142719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:42.146068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:42.146518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:42.384623 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:42.385248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:42.397194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:42.397650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:42.398483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:42.398921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:42.511930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:42.519978 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e09e5da1-b289-4ab1-8553-604565b10898 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.407682 Jan 11 03:57:42.520558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 34/71] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:42 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:42.628865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:42.642102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5e32ca6f-c884-45c1-ac1f-a7976580f65f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1233 microversion: 2.1 time: 0.261527 Jan 11 03:57:42.645385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 38/72] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:42 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1233 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:43.058053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:43.058859 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:43.082416 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:43.084432 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:43.087554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:43.090797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:43.539751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:43.540438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:43.579814 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:43.587943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:43.589923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:43.598389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:44.271516 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:44.282681 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63ad7bf6-e9b0-4f73-9244-36ea17a8f3bb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 1.234778 Jan 11 03:57:44.284162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 35/73] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:43 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:44.294019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:44.295381 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:44.308369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:44.309233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:44.310994 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:44.312159 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:44.516206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:44.530758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e55eaf7b-d7de-42f2-a662-124b94f8e562 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1295 microversion: 2.1 time: 0.240372 Jan 11 03:57:44.534297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 36/74] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:44 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1295 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:44.784965 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:44.799920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4f261b9a-9a81-4e61-a6c6-27c914128b9d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 1.263650 Jan 11 03:57:44.803086 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 39/75] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:43 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:45.216801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-eb0e3017-9bcb-4166-a84f-5b66da6de59f req-7246f6c6-024f-40c5-9a27-4ea7bfc0199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e5e3e3-d66c-4a1d-9617-e9fce9b441fa", "tag": "99e274a2-def2-4d98-bbe5-503acf6b9354"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:45.226563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:57:45.226563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:57:45.255345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-eb0e3017-9bcb-4166-a84f-5b66da6de59f req-7246f6c6-024f-40c5-9a27-4ea7bfc0199f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.255797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-eb0e3017-9bcb-4166-a84f-5b66da6de59f req-7246f6c6-024f-40c5-9a27-4ea7bfc0199f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.300810 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:45.301442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:45.310685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.311164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.312602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.320848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.331784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-eb0e3017-9bcb-4166-a84f-5b66da6de59f req-7246f6c6-024f-40c5-9a27-4ea7bfc0199f service nova] Creating event network-changed:99e274a2-def2-4d98-bbe5-503acf6b9354 for instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa on hv-cinder-81977 Jan 11 03:57:45.333111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-eb0e3017-9bcb-4166-a84f-5b66da6de59f req-7246f6c6-024f-40c5-9a27-4ea7bfc0199f service nova] Acquired lock "compute-rpcapi-router" {{(pid=116388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 03:57:45.334500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.336520 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.345312 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.347769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.376410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.compute.rpcapi [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 03:57:45.377386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] Releasing lock "compute-rpcapi-router" {{(pid=116388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 03:57:45.408660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d656f004-6026-4d25-b61b-589d5d6d9fca None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304829 Jan 11 03:57:45.409113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 37/76] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:45.551231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:45.552031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:45.566940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.570930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.571715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.572254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.943163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:45.955017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-86f4be40-0c39-47ee-9d5e-299a00ecfe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1295 microversion: 2.1 time: 0.408561 Jan 11 03:57:45.955917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 38/77] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:45 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1295 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:45.970713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:45.971286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:45.980656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.981514 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:45.982612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:45.983221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:46.106648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:46.117495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-894e9e21-9a46-463f-8861-37d0156f737a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.820025 Jan 11 03:57:46.118375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 40/78] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:45 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:46.248816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:46.259483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-041e746f-146a-4089-b9c5-b5202bcbdb1d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.302223 Jan 11 03:57:46.270966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 39/79] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:45 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:46.346264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-609087cb-26e0-49bf-b209-372ceb790b19 req-09f853c3-ae6a-4aac-bcf3-827a9eca6017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4", "tag": "4656f61c-2c13-453b-a68e-993e311d96cb"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:46.353277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:57:46.353277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:57:46.366890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-609087cb-26e0-49bf-b209-372ceb790b19 req-09f853c3-ae6a-4aac-bcf3-827a9eca6017 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:46.367676 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-609087cb-26e0-49bf-b209-372ceb790b19 req-09f853c3-ae6a-4aac-bcf3-827a9eca6017 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:46.395482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-609087cb-26e0-49bf-b209-372ceb790b19 req-09f853c3-ae6a-4aac-bcf3-827a9eca6017 service nova] Creating event network-changed:4656f61c-2c13-453b-a68e-993e311d96cb for instance 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 on hv-cinder-81977 Jan 11 03:57:46.396887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-609087cb-26e0-49bf-b209-372ceb790b19 req-09f853c3-ae6a-4aac-bcf3-827a9eca6017 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 11 03:57:46.398330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:46.398942 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:46.400337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:46.401439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:46.415818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.compute.rpcapi [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 11 03:57:46.417956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] Releasing lock "compute-rpcapi-router" {{(pid=116387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 11 03:57:46.444941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1123fd79-5fbd-41b6-83a7-7d82a1d954ed None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187616 Jan 11 03:57:46.445732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 41/80] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:46.910845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-31ec1c24-96e8-4b6b-8e7f-8551f8f180d1 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e66501b80>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:46.973738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:46.974650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:46.988390 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:46.989141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:46.990298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:46.991494 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:47.020806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-31ec1c24-96e8-4b6b-8e7f-8551f8f180d1 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/355da65e-9e67-4723-a039-2a953adec415" status: 200 len: 351 microversion: 2.1 time: 0.121265 Jan 11 03:57:47.027016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 40/81] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:46 2022] GET /compute/v2.1/os-volumes/355da65e-9e67-4723-a039-2a953adec415 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:47.136307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:47.137009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:47.145776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:47.149299 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:47.150482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:47.153854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:47.590829 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:47.600027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cf7a69b5-8134-4402-ab95-b32fe023038e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.631493 Jan 11 03:57:47.611666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 42/82] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:46 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:47.616679 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:47.625456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:47.626582 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:47.634093 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-19ea32ad-5b56-4ee2-a89a-9425222c6ff7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.491829 Jan 11 03:57:47.634866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 41/83] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:47 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:47.636445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:47.636976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:47.637898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:47.638523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:47.972379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:47.982124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-20e823fb-b6ae-40e9-bc2a-9c0494f1567f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.367495 Jan 11 03:57:47.985004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 43/84] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:47 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:48.524960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-98e49ab5-447a-4fb3-8734-e380d0c42821 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e665455e0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:48.626036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:48.626837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:48.635918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:48.638282 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:48.640635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:48.642521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:48.730466 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-98e49ab5-447a-4fb3-8734-e380d0c42821 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/023564ac-2ef8-4e9e-8649-6d9f27cffebb" status: 200 len: 351 microversion: 2.1 time: 0.207920 Jan 11 03:57:48.730466 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 42/85] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:48 2022] GET /compute/v2.1/os-volumes/023564ac-2ef8-4e9e-8649-6d9f27cffebb => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:48.734981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:48.738147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:48.781379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:48.782187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:48.787476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:48.787954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:49.263870 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:49.274607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0beec272-6e3f-45c0-a168-738b90939ad6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.652126 Jan 11 03:57:49.288511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 44/86] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:48 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:49.292785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-d6d3caaf-2cc2-4ca9-9ded-77a040ce3e72 req-3fae64c6-0374-4d25-804c-36e7a3ccae36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36cfea01-d609-4829-8083-058ca877eab5", "tag": "97ee7a9f-cd30-46f2-9c18-083665b1f24e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:49.295752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:57:49.295752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:57:49.305100 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-d6d3caaf-2cc2-4ca9-9ded-77a040ce3e72 req-3fae64c6-0374-4d25-804c-36e7a3ccae36 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:49.305543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-d6d3caaf-2cc2-4ca9-9ded-77a040ce3e72 req-3fae64c6-0374-4d25-804c-36e7a3ccae36 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:49.320918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-d6d3caaf-2cc2-4ca9-9ded-77a040ce3e72 req-3fae64c6-0374-4d25-804c-36e7a3ccae36 service nova] Creating event network-changed:97ee7a9f-cd30-46f2-9c18-083665b1f24e for instance 36cfea01-d609-4829-8083-058ca877eab5 on hv-cinder-81977 Jan 11 03:57:49.323850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:49.326462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-d6d3caaf-2cc2-4ca9-9ded-77a040ce3e72 req-3fae64c6-0374-4d25-804c-36e7a3ccae36 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041743 Jan 11 03:57:49.328088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 45/87] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:49.336993 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:49.338059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:49.340350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-de886a2d-f41f-46f8-97a2-0ba620aaf303 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.608975 Jan 11 03:57:49.341237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 43/88] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:48 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:49.348469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:49.349245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:49.350584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:49.351952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:49.587852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:49.597593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c75eada2-6c78-4034-aee4-c32bde48afea tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.267418 Jan 11 03:57:49.598229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 46/89] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:49 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.298617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.298617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:50.305134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-488972f1-b167-4648-ac1e-8fb8479a97e8 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e66462820>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.306544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.307063 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.312381 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.312843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.430382 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-488972f1-b167-4648-ac1e-8fb8479a97e8 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/422d1494-2d3d-4d8f-a93c-da8f76c090af" status: 200 len: 351 microversion: 2.1 time: 0.130045 Jan 11 03:57:50.438601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 47/90] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/os-volumes/422d1494-2d3d-4d8f-a93c-da8f76c090af => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:50.443541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.444655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:50.451546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.452519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.454231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.454853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.552318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:50.564510 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4df31357-7834-4516-a939-608d938abba6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.269993 Jan 11 03:57:50.565967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 44/91] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.586197 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a9c79473-5e10-4353-a847-b926388fa671 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e65c56940>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.645395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:50.653063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0a89f52b-250d-4233-b70e-e0deb365b710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.212853 Jan 11 03:57:50.657080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 48/92] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.661700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.662313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:50.674867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.676128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.677147 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:50.677987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:50.730823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a9c79473-5e10-4353-a847-b926388fa671 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.155810 Jan 11 03:57:50.731769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 45/93] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.743882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a6e973f9-3ae4-4e6b-9dc6-c59132444016 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e65c86940>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.851121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a6e973f9-3ae4-4e6b-9dc6-c59132444016 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.110896 Jan 11 03:57:50.851930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 46/94] 10.222.0.24 () {58 vars in 1148 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:57:50.864167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bfa74e04-1d9d-456f-9ca0-bf9e9d94767c tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e665454c0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:50.910020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:50.921617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0f62b2c7-4299-4775-b2c4-d42441130f8c tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.262084 Jan 11 03:57:50.922867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 49/95] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.958329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bfa74e04-1d9d-456f-9ca0-bf9e9d94767c tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.098397 Jan 11 03:57:50.959573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 47/96] 10.222.0.24 () {58 vars in 1133 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:50.971718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-949444ef-5c3f-40ac-b83a-672c5dc67984 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e66462e50>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.054165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-949444ef-5c3f-40ac-b83a-672c5dc67984 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087030 Jan 11 03:57:51.055358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 50/97] 10.222.0.24 () {58 vars in 1166 bytes} [Tue Jan 11 03:57:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:51.066705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8da9d1da-53ca-4550-9fd3-a48fbca50713 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e65ccd700>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.147548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8da9d1da-53ca-4550-9fd3-a48fbca50713 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084812 Jan 11 03:57:51.148182 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 48/98] 10.222.0.24 () {58 vars in 1169 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:51.160686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fa2627ec-3f5f-4cf1-bf4b-bf55cf3daacc tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e664e9ee0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.240754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fa2627ec-3f5f-4cf1-bf4b-bf55cf3daacc tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083636 Jan 11 03:57:51.241482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 51/99] 10.222.0.24 () {58 vars in 1154 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:51.252296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6ab9b378-570a-48bc-b7ed-46f666e06d36 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e65cb6670>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.350545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6ab9b378-570a-48bc-b7ed-46f666e06d36 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101769 Jan 11 03:57:51.353721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 49/100] 10.222.0.24 () {58 vars in 1187 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:51.363235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-83ce83c6-ac81-440e-aea2-ef3824ba2005 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] Calling method '.version_select at 0x7f4e66451b80>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.456131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-83ce83c6-ac81-440e-aea2-ef3824ba2005 tempest-VolumesTestJSON-1147263182 tempest-VolumesTestJSON-1147263182-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.097294 Jan 11 03:57:51.456838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 52/101] 10.222.0.24 () {58 vars in 1154 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:51.583725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.584378 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:51.600248 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.600906 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.601830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.602174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.673521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.674766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:51.689655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.691052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.693129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.695055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.931756 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:51.939847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-81975648-a4e3-4390-a81e-f6489b8a7a23 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.360254 Jan 11 03:57:51.940418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 50/102] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:51.947331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:51.950710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:51.958016 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:51.964604 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.965249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.966471 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:51.967178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:51.976356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-38782812-3275-4b01-994a-06c1e9f94e1d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.305217 Jan 11 03:57:51.985860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 53/103] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:52.141524 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:52.148858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-42219e09-400d-4d5f-9a4f-f9d653e46252 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.205724 Jan 11 03:57:52.150784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 51/104] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:51 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:52.958254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:52.959109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:52.967964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:52.970023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:52.970948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:52.971506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:52.999619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:53.002996 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:53.014872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:53.015704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:53.018227 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:53.019866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:53.228742 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:53.239569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c6d8102d-98cf-45e4-bf8f-612bbb478886 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.286348 Jan 11 03:57:53.240162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 54/105] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:52 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:53.252211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:53.254604 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:53.266281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:53.268787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:53.271888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:53.272461 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:53.323964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:53.343742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c22bb365-2e2e-4f00-80bf-f0ef5fdd3524 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.352535 Jan 11 03:57:53.349451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 52/106] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:52 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:53.457544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:53.466218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-09c703e0-6a5c-47d4-a773-15613c6f8a6e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.222969 Jan 11 03:57:53.467421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 55/107] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:53 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:54.256105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:54.256719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:54.262556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.263222 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.264411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.265822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.367974 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:54.369533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:54.378270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.379019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.380020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.380687 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.427265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:54.436679 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2460010b-547e-43bf-bb57-aa535281df10 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.183978 Jan 11 03:57:54.442236 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 53/108] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:54 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:54.486310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:54.488010 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:54.497503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.498693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.500066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:54.505656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:54.627196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:54.634934 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6fa2d002-8276-45f7-a462-c6ac01a27d3e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.273253 Jan 11 03:57:54.635504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 56/109] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:54 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:54.748122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:54.755773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e80e9068-ee43-4fbf-800b-6f806540263a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.275002 Jan 11 03:57:54.756356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 54/110] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:54 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:55.462132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:55.463067 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:55.469992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.471284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.473306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.474811 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.656033 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:55.658047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:55.658577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:55.671019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.671805 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-342e20ad-f4ce-47b1-b853-62f3a0673aa8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.214052 Jan 11 03:57:55.673029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.674031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.674762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.681537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 57/111] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:55 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:55.774014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:55.774646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:55.790290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.791992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.794295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:55.796932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:55.959762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:55.971456 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ec1b1379-e63f-466b-b2b9-a7b1400365af tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.322044 Jan 11 03:57:55.972440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 55/112] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:55 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:56.086761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:56.096094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4629de97-3c06-4ddc-9fc4-32a27839c4d5 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.327630 Jan 11 03:57:56.097658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 58/113] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:55 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:56.689262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:56.689980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:56.695926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:56.696540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:56.697639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:56.698238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:56.840418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:56.849277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7306c18e-4e23-4f78-975e-2d1a9d8704e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.164860 Jan 11 03:57:56.850132 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 56/114] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:56 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:56.988768 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:56.989383 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:56.996315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:56.997048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:56.998484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:56.999074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:57.129044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:57.130008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:57.141244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:57.142480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:57.145538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:57.147514 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:57.487462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:57.508007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1b97bc0d-1e8b-4162-bb61-f29a4b5013a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.522757 Jan 11 03:57:57.508612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 59/115] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:56 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:57.658388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:57.668504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-82130a5d-0b8e-44f2-b481-faa903ef26f0 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.558121 Jan 11 03:57:57.669073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 57/116] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:57 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:57.867734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:57.869315 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:57.875686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:57.876401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:57.877410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:57.878085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:57.959843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3df8f645-7705-48de-b947-9f2ad53a595e tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Action: 'create', calling method: .version_select at 0x7f4e664e90d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1727605132", "metadata": {"Type": "work"}}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:57.961760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3df8f645-7705-48de-b947-9f2ad53a595e tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:57.962706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3df8f645-7705-48de-b947-9f2ad53a595e tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.453173 Jan 11 03:57:57.963405 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 60/117] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Jan 11 03:57:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 454 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 03:57:57.974265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ca157a3f-b65d-44c1-baed-acdcdc15eb97 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Action: 'create', calling method: .version_select at 0x7f4e66451af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-399407188", "metadata": {"Type": "work"}}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:57.975659 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ca157a3f-b65d-44c1-baed-acdcdc15eb97 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:57.976580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ca157a3f-b65d-44c1-baed-acdcdc15eb97 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006008 Jan 11 03:57:57.977245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 61/118] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Jan 11 03:57:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 03:57:57.987789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7d789cb8-8ad3-4e8a-aaa4-766c984e4835 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Action: 'create', calling method: .version_select at 0x7f4e680d2f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-210625336", "metadata": {"Type": "work"}}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:57.989225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7d789cb8-8ad3-4e8a-aaa4-766c984e4835 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:57.990667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7d789cb8-8ad3-4e8a-aaa4-766c984e4835 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007865 Jan 11 03:57:57.995596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 62/119] 10.222.0.24 () {60 vars in 1155 bytes} [Tue Jan 11 03:57:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 11 03:57:58.000410 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0f3f46aa-8ee1-4711-aedc-759fd99e2421 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Calling method '.version_select at 0x7f4e665299d0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:58.035106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-0f3f46aa-8ee1-4711-aedc-759fd99e2421 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] HTTP exception thrown: Volume tempest-invalid-1406242385 could not be found. Jan 11 03:57:58.035639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0f3f46aa-8ee1-4711-aedc-759fd99e2421 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 404 to user: Volume tempest-invalid-1406242385 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:58.036639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0f3f46aa-8ee1-4711-aedc-759fd99e2421 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1406242385" status: 404 len: 99 microversion: 2.1 time: 0.039879 Jan 11 03:57:58.037423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 63/120] 10.222.0.24 () {58 vars in 1217 bytes} [Tue Jan 11 03:57:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1406242385 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 11 03:57:58.047759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-70ee014e-b7c2-4522-a5d9-3cf95ba047a7 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004687 Jan 11 03:57:58.048479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 64/121] 10.222.0.24 () {58 vars in 1139 bytes} [Tue Jan 11 03:57:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 11 03:57:58.062499 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-da1ec4bf-5303-49d2-8eca-39a22cb5950f tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005977 Jan 11 03:57:58.066023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 65/122] 10.222.0.24 () {58 vars in 1136 bytes} [Tue Jan 11 03:57:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 11 03:57:58.074690 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:58.077975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5af501d4-39e3-4bac-bd28-47aae024ab29 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Calling method '.version_select at 0x7f4e66502790>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:58.086483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-953593d6-0a0a-43e0-98dc-4701882ebc59 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.222666 Jan 11 03:57:58.087090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 58/123] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:57 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:58.118698 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-5af501d4-39e3-4bac-bd28-47aae024ab29 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] HTTP exception thrown: Volume 47ef1aa3-2ade-4bbc-b3fc-c9840e5a7efa could not be found. Jan 11 03:57:58.119863 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5af501d4-39e3-4bac-bd28-47aae024ab29 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 404 to user: Volume 47ef1aa3-2ade-4bbc-b3fc-c9840e5a7efa could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:58.121718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5af501d4-39e3-4bac-bd28-47aae024ab29 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/47ef1aa3-2ade-4bbc-b3fc-c9840e5a7efa" status: 404 len: 109 microversion: 2.1 time: 0.052078 Jan 11 03:57:58.123281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 66/124] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 03:57:58 2022] DELETE /compute/v2.1/os-volumes/47ef1aa3-2ade-4bbc-b3fc-c9840e5a7efa => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 03:57:58.134386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-dcb88ae7-d88b-455f-b084-83b89fc6e443 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Calling method '.version_select at 0x7f4e66545f70>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:58.175371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-dcb88ae7-d88b-455f-b084-83b89fc6e443 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] HTTP exception thrown: Volume 78c5df93-9940-4a24-82ad-036dc41262dc could not be found. Jan 11 03:57:58.176140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-dcb88ae7-d88b-455f-b084-83b89fc6e443 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] Returning 404 to user: Volume 78c5df93-9940-4a24-82ad-036dc41262dc could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:57:58.177947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-dcb88ae7-d88b-455f-b084-83b89fc6e443 tempest-VolumesNegativeTest-1632300859 tempest-VolumesNegativeTest-1632300859-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/78c5df93-9940-4a24-82ad-036dc41262dc" status: 404 len: 109 microversion: 2.1 time: 0.048736 Jan 11 03:57:58.179435 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 59/125] 10.222.0.24 () {58 vars in 1244 bytes} [Tue Jan 11 03:57:58 2022] GET /compute/v2.1/os-volumes/78c5df93-9940-4a24-82ad-036dc41262dc => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:57:58.524005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:58.524614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:58.532534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:58.533233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:58.534057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:58.534645 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:58.616695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-54df7dde-8f67-40ed-a9b5-91bc8340a89d req-31d8897f-e34b-4f70-9a18-28e56fba109d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5e3e3-d66c-4a1d-9617-e9fce9b441fa", "name": "network-vif-plugged", "status": "completed", "tag": "99e274a2-def2-4d98-bbe5-503acf6b9354"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:57:58.619036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:57:58.619036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:57:58.639744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-54df7dde-8f67-40ed-a9b5-91bc8340a89d req-31d8897f-e34b-4f70-9a18-28e56fba109d service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:58.640989 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-54df7dde-8f67-40ed-a9b5-91bc8340a89d req-31d8897f-e34b-4f70-9a18-28e56fba109d service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:58.658215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-54df7dde-8f67-40ed-a9b5-91bc8340a89d req-31d8897f-e34b-4f70-9a18-28e56fba109d service nova] Creating event network-vif-plugged:99e274a2-def2-4d98-bbe5-503acf6b9354 for instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa on hv-cinder-81977 Jan 11 03:57:58.666366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-54df7dde-8f67-40ed-a9b5-91bc8340a89d req-31d8897f-e34b-4f70-9a18-28e56fba109d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332139 Jan 11 03:57:58.669893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 67/126] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:57:58.695348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:58.695348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:58.707341 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:58.707959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:58.708882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:58.709320 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:58.750818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:58.762201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-91fef756-c835-4822-8d94-50faee90afbc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.239447 Jan 11 03:57:58.763192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 60/127] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:58 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:58.872009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:58.881960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fd4601ac-f510-4b9b-b75f-0a54c9155f92 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.198257 Jan 11 03:57:58.883891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 68/128] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:58 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:57:59.103786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:59.104497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:59.112420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.113312 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.114812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.115808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.500889 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:59.509436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ada35d9d-0a04-480f-b64b-7d0be2b85c16 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.409494 Jan 11 03:57:59.515713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 61/129] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:59 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:57:59.779554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:59.780233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:59.787446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.787833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.788957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.789592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.897958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:57:59.898903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:57:59.906663 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.907193 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.908200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:57:59.908869 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:57:59.932543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:57:59.941165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7ff4f241-28dc-4b89-97d7-e84196efa193 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.165904 Jan 11 03:57:59.942627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 69/130] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:59 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:00.059683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:00.071398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-78664b69-bb1c-4a59-9983-79c52c142a9b tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.177055 Jan 11 03:58:00.081309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 62/131] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:57:59 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:00.533492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:00.534245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:00.541288 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:00.541980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:00.543116 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:00.543678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:00.686646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cfea01-d609-4829-8083-058ca877eab5", "name": "network-vif-plugged", "status": "completed", "tag": "97ee7a9f-cd30-46f2-9c18-083665b1f24e"}, {"server_uuid": "385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4", "name": "network-vif-plugged", "status": "completed", "tag": "4656f61c-2c13-453b-a68e-993e311d96cb"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:00.690391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:00.695316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:00.695316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:58:00.704009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-18d4de67-1ee0-4f0c-a1c6-22bc9fced59c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.176918 Jan 11 03:58:00.705048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 70/132] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:00 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:00.709787 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:00.710964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:00.726139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] Creating event network-vif-plugged:97ee7a9f-cd30-46f2-9c18-083665b1f24e for instance 36cfea01-d609-4829-8083-058ca877eab5 on hv-cinder-81977 Jan 11 03:58:00.726907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] Creating event network-vif-plugged:4656f61c-2c13-453b-a68e-993e311d96cb for instance 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 on hv-cinder-81977 Jan 11 03:58:00.735723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-1a308cb4-9f9c-459d-a897-b7e3b5513e0a req-8786b1d1-506f-4035-b9e8-8c7c2e063941 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053943 Jan 11 03:58:00.737015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 63/133] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:00.958602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:00.959973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:00.967757 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:00.969073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:00.970157 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:00.970801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:01.092031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:01.094283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:01.102615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:01.103218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:01.104571 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:01.105492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:01.766043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:01.768117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:01.779173 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fc5f82eb-756f-45b8-851f-6c2edde8d112 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.824193 Jan 11 03:58:01.780136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ab2794e3-3495-43f4-9983-fb06e1135bcf tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1315 microversion: 2.1 time: 0.692550 Jan 11 03:58:01.781122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 71/134] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:00 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:01.782088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 64/135] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:01 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:01.785848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:01.786593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:01.792706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:01.793163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:01.793986 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:01.794424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:01.978087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:01.994801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c59e00f0-0124-4833-8019-fd6ef78c7a88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.212191 Jan 11 03:58:01.996021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 72/136] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:01 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:02.798285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:02.799375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:02.799482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:02.800043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:02.808693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:02.810969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:02.811394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:02.811500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:02.812331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:02.813131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:02.816019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:02.816781 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:03.197483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:03.209610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e9db1d32-a1f3-4f12-8f6f-e6af8e91fe2e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1502 microversion: 2.1 time: 0.415595 Jan 11 03:58:03.221920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 73/137] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:02 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:03.221920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:03.221920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:03.221920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:03.222401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:03.223236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:03.223664 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:03.255917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:03.266156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-83c29b54-e211-45ab-89c6-f41ff38979a0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1318 microversion: 2.1 time: 0.473390 Jan 11 03:58:03.287044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 65/138] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:02 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:03.543027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:03.557940 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1fe40249-bdcf-4032-adf2-3dfaa27079e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1362 microversion: 2.1 time: 0.340434 Jan 11 03:58:03.558616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 74/139] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:03 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:04.296725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:04.297611 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:04.305574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.306826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:04.308809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.309646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:04.503503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:04.517701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6a917835-87b9-43a5-b434-0f62e225b804 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1508 microversion: 2.1 time: 0.222320 Jan 11 03:58:04.519536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 66/140] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:04 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:04.576624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:04.578214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:04.595083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.596718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:04.599779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.600231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:04.822310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:04.830960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-36ec8327-f39a-4722-8f75-b36d46f9df34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1547 microversion: 2.1 time: 0.258317 Jan 11 03:58:04.844117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 75/141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:04 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1547 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:04.852428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:04.853469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:04.863896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.864811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:04.870149 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:04.871904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:05.098379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "123795b1-5794-46c6-b0f1-a0a7a120c0ac"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:05.099643 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:05.114400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:05.114998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:05.116480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:05.117335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:05.185087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7cb95ccf-3cb7-436c-b98d-1a40beb22440 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337507 Jan 11 03:58:05.186064 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 67/142] 10.222.0.24 () {58 vars in 1274 bytes} [Tue Jan 11 03:58:04 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:05.666117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0ecac266-573f-4428-94ab-44de86ba863a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "POST /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571899 Jan 11 03:58:05.668530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 76/143] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 03:58:05 2022] POST /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:06.199383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6861f0a5-a6db-4b18-95f1-eebbd63da93f"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:06.200855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:06.206783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:06.207875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:06.209017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:06.209532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:06.896126 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-47b6aeae-709c-4d6f-bb02-8396e6531eb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699543 Jan 11 03:58:06.897453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 68/144] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 03:58:06 2022] POST /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:07.020947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:07.022017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:07.026210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-afe13c70-578f-45c1-9bc2-1f6e1f8030fc req-471e958e-d9da-4bd7-8b74-a1bfc56c1bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36cfea01-d609-4829-8083-058ca877eab5", "tag": "97ee7a9f-cd30-46f2-9c18-083665b1f24e"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:07.028270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:07.028270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:58:07.035154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:07.037665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-afe13c70-578f-45c1-9bc2-1f6e1f8030fc req-471e958e-d9da-4bd7-8b74-a1bfc56c1bc2 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:07.038340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-afe13c70-578f-45c1-9bc2-1f6e1f8030fc req-471e958e-d9da-4bd7-8b74-a1bfc56c1bc2 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:07.041994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:07.043060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:07.043539 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:07.052781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-afe13c70-578f-45c1-9bc2-1f6e1f8030fc req-471e958e-d9da-4bd7-8b74-a1bfc56c1bc2 service nova] Creating event network-changed:97ee7a9f-cd30-46f2-9c18-083665b1f24e for instance 36cfea01-d609-4829-8083-058ca877eab5 on hv-cinder-81977 Jan 11 03:58:07.065342 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-afe13c70-578f-45c1-9bc2-1f6e1f8030fc req-471e958e-d9da-4bd7-8b74-a1bfc56c1bc2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043130 Jan 11 03:58:07.070973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 69/145] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:58:07.165997 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2460d858-af00-4ddf-b8c9-7b10997aefcd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.150216 Jan 11 03:58:07.171905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 77/146] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:07 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:58:08.188071 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:08.189391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:08.203694 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:08.204806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:08.207674 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:08.228341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:08.351343 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b7c7e512-0475-40a6-be35-c1f5c125c317 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.174311 Jan 11 03:58:08.351972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 70/147] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:08 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:09.365058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:09.366466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:09.376552 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:09.377344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:09.378620 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:09.379364 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:09.471946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5516e9aa-c888-45cd-a67c-ac65d36f188b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.113151 Jan 11 03:58:09.472567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 78/148] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:09 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:58:10.484818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:10.485808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:10.507853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:10.508922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:10.510245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:10.511618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:10.618028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-60e80a00-a4c9-4910-92bc-dad3ad761dc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.138246 Jan 11 03:58:10.618700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 71/149] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:10 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:11.629599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:11.631351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:11.639400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:11.640154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:11.641342 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:11.641895 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:11.757317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a90b618c-d377-41fc-a9aa-92f809741407 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.131410 Jan 11 03:58:11.758369 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 79/150] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:11 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:58:12.496066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1734190136", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "95cb0cc0-c947-4f16-b117-534294a7eb6c"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:12.555505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] validate_networks() for [('95cb0cc0-c947-4f16-b117-534294a7eb6c', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:12.769291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:12.770325 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:12.791545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:12.792519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:12.793378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:12.794050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:12.907434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ecb7e4ab-f5e0-4b89-9143-3f05540828e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.142118 Jan 11 03:58:12.909428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 80/151] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:12 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:13.033255 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:13.033710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:13.034238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:13.034590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:13.035127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:13.046418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:13.046864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:13.055471 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:13.055471 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:13.089551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Getting quotas for project accdf5658e784e44844fe761d25869c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:13.093721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Getting quotas for user 56fc15f4739f493bba82a3cb72a20fa3 and project accdf5658e784e44844fe761d25869c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:13.121732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:13.124765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:13.188078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1d355a3e-7846-48f3-a18d-3a81937fcdaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696104 Jan 11 03:58:13.188917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 72/152] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:58:13.199836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e0d9022c-d74f-465f-9780-196cade21750 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:13.200781 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e0d9022c-d74f-465f-9780-196cade21750 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:13.307897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e0d9022c-d74f-465f-9780-196cade21750 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:13.316235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e0d9022c-d74f-465f-9780-196cade21750 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1214 microversion: 2.1 time: 0.120265 Jan 11 03:58:13.317024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 81/153] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:13 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:13.919039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:13.921287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:13.939233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:13.939763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:13.941781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:13.944076 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:14.085998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f562d479-a49a-42c2-8409-050e45e9b2c0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.170724 Jan 11 03:58:14.086640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 73/154] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:13 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:14.337844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:14.338473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:14.346772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:14.347432 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:14.348215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:14.348648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:14.435385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:14.450149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3766329e-f9c3-4532-928f-c36098358824 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1266 microversion: 2.1 time: 0.115746 Jan 11 03:58:14.450149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 82/155] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:14 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:15.098102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:15.099561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:15.117586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:15.118410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:15.119417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:15.119873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:15.281613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f3cae602-14bc-4c14-80e4-e467a52a3982 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.185268 Jan 11 03:58:15.289174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 74/156] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:15 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:58:15.468472 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:15.470577 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:15.481868 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:15.483982 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:15.485840 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:15.487175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:15.768708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:15.777097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-95661832-e756-4910-9442-c5513721d653 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.314730 Jan 11 03:58:15.777701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 83/157] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:15 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:15.998133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:15.999576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:16.015651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.019338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.022560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.023012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.080024 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 03:58:16.245910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-35a16982-e793-444d-8407-1568d065386e tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 204 len: 0 microversion: 2.1 time: 0.251944 Jan 11 03:58:16.247219 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 75/158] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 03:58:15 2022] DELETE /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 03:58:16.255568 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:16.256180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:16.270371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.271010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.272244 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.272838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.303178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:16.304441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:16.313340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.314179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.315039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.315554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.427812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c77711f1-aa34-4d30-9247-c5b292de307f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.131830 Jan 11 03:58:16.428452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 76/159] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:16 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:16.536926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:16.562414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-84b60b6b-cad0-4332-8a33-65f1d44495ff tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1554 microversion: 2.1 time: 0.305406 Jan 11 03:58:16.563069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 84/160] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:16 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:16.603966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-f70ded26-d204-4265-9d3f-962eff312de0 req-130e00e0-f9dd-4977-8d22-3d911202765c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2811bcc-8a93-44d0-8fca-057f8f1bcff0", "tag": "d557758e-9e23-4e41-9077-811c8f235c2a"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:16.606153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:16.606153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:58:16.626999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-f70ded26-d204-4265-9d3f-962eff312de0 req-130e00e0-f9dd-4977-8d22-3d911202765c service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.627742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-f70ded26-d204-4265-9d3f-962eff312de0 req-130e00e0-f9dd-4977-8d22-3d911202765c service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.642257 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-f70ded26-d204-4265-9d3f-962eff312de0 req-130e00e0-f9dd-4977-8d22-3d911202765c service nova] Creating event network-changed:d557758e-9e23-4e41-9077-811c8f235c2a for instance d2811bcc-8a93-44d0-8fca-057f8f1bcff0 on hv-cinder-81977 Jan 11 03:58:16.649394 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-f70ded26-d204-4265-9d3f-962eff312de0 req-130e00e0-f9dd-4977-8d22-3d911202765c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050164 Jan 11 03:58:16.650825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 77/161] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:16.803736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:16.804338 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:16.812991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.813487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:16.814256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:16.814687 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:17.063109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:17.078848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-644665df-174e-4c1a-bfdf-c713af0fdaaa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.277218 Jan 11 03:58:17.083265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 85/162] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:16 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:17.440267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:17.441267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:17.449923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:17.450626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:17.451583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:17.459717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:17.579425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:17.580043 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:17.591082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:17.591486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:17.592304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:17.593231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:17.689765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ed2e723e-d26d-4cde-be58-6933fb8ea53f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 14 microversion: 2.1 time: 0.254373 Jan 11 03:58:17.690700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 78/163] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:17 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:58:17.974583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:17.983562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-63313bef-c731-4206-a738-b1e3ba1b4279 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1554 microversion: 2.1 time: 0.407380 Jan 11 03:58:17.989143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 86/164] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:17 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:18.112133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:18.115226 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:18.125319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:18.128907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:18.131574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:18.134455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:18.525392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:18.536215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0eeb4727-9b5d-4de7-9aea-0073e2cca268 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.433178 Jan 11 03:58:18.537503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 79/165] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:18 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:18.700358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:18.701334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:18.709779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:18.710474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:18.711546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:18.712420 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:18.834594 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4f061543-1b83-4e3b-8f5d-27a0e21b996a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 8666 microversion: 2.1 time: 0.137636 Jan 11 03:58:18.838012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 87/166] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:18 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 8666 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:19.007600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:19.008736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:19.016112 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.016879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.017871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.018452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.392158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:19.400343 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8d95d02c-ed7d-469c-b941-b038116d278a tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1554 microversion: 2.1 time: 0.396286 Jan 11 03:58:19.401097 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 80/167] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:19 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1554 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:19.553360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:19.554249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:19.561936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.562735 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.563853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.564495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.854817 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:19.856447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:19.864245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.864837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.865843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.866512 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.884634 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:19.891900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-319022f1-6233-4b87-9aff-61b450e97bfa tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.343045 Jan 11 03:58:19.892472 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 88/168] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:19 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:19.903128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-f3b3dce9-1226-48a6-8e52-a6d18eee12d8 req-95cf8a10-84f4-403a-ad74-f3dbb48d2749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e5e3e3-d66c-4a1d-9617-e9fce9b441fa", "name": "network-vif-deleted", "tag": "99e274a2-def2-4d98-bbe5-503acf6b9354"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:19.904674 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:19.904674 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:58:19.915690 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-f3b3dce9-1226-48a6-8e52-a6d18eee12d8 req-95cf8a10-84f4-403a-ad74-f3dbb48d2749 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:19.916136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-f3b3dce9-1226-48a6-8e52-a6d18eee12d8 req-95cf8a10-84f4-403a-ad74-f3dbb48d2749 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:19.927313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-f3b3dce9-1226-48a6-8e52-a6d18eee12d8 req-95cf8a10-84f4-403a-ad74-f3dbb48d2749 service nova] Creating event network-vif-deleted:99e274a2-def2-4d98-bbe5-503acf6b9354 for instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa on hv-cinder-81977 Jan 11 03:58:19.932371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-f3b3dce9-1226-48a6-8e52-a6d18eee12d8 req-95cf8a10-84f4-403a-ad74-f3dbb48d2749 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037641 Jan 11 03:58:19.933264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 89/169] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:20.418319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:20.419013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:20.425808 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:20.426437 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:20.427222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:20.427913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:20.497378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:20.505594 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-99910ad1-6265-49ec-97ae-f70f1b37e82f tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1512 microversion: 2.1 time: 0.091681 Jan 11 03:58:20.506197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 90/170] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:20 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1512 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:20.921240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:20.922737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:20.930217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:20.931119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:20.932201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:20.932841 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:21.148134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:21.157163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2182e464-df78-40be-a51b-963270fc8175 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.252100 Jan 11 03:58:21.157627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 91/171] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:20 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:21.524540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:21.525233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:21.532617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:21.533314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:21.534210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:21.534759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:21.610134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:21.619298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-32551e27-a9f6-4739-8abf-e32d6ba26a3d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1346 microversion: 2.1 time: 0.100038 Jan 11 03:58:21.628713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 92/172] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:21 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:22.173083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:22.173707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:22.179965 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:22.180360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:22.181178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:22.181615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:22.310306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:22.317612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-22f53bfb-74dd-4b0e-bb3b-bdb8ca5ccb4c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.148598 Jan 11 03:58:22.318243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 93/173] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:22 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:22.634725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:22.635336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:22.641642 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:22.642122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:22.642958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:22.643395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:22.702707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:22.710703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ee643ddd-aa55-4090-ade9-7f0efcaaed4d tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1346 microversion: 2.1 time: 0.079535 Jan 11 03:58:22.711208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 94/174] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:22 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:23.334562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:23.335160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:23.341378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:23.341861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:23.342624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:23.343056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:23.474061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:23.481284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5d7f5833-3b4c-488c-b915-9130acb15aff tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.150277 Jan 11 03:58:23.481900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 95/175] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:23 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:23.727575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:23.728181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:23.733975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:23.734449 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:23.735206 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:23.735637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:23.807707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:23.817417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9e44b01c-5c1b-4272-b6dc-97170dec95d7 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1346 microversion: 2.1 time: 0.093473 Jan 11 03:58:23.818355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 96/176] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:23 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:24.167030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d8cdf155-a4c8-485d-b44f-b72dd4c34904 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 22064 microversion: 2.1 time: 4.324618 Jan 11 03:58:24.167673 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 81/177] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:19 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 22064 bytes in 4326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:24.498379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:24.498985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:24.505162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:24.505608 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:24.506411 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:24.506844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:24.636102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:24.644785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c436d09d-5547-4454-a702-7c54b3ebe472 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.149908 Jan 11 03:58:24.645359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 97/178] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:24 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:24.834678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:24.835293 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:24.842163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:24.842607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:24.843373 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:24.843801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:24.910131 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:24.918446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5077fcb4-5da4-4668-ad3c-37f2ed7e2433 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1346 microversion: 2.1 time: 0.087838 Jan 11 03:58:24.919005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 82/179] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:24 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:25.179170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:25.180011 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:25.185792 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.186730 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:25.187498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.187929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:25.285275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e0b3ff85-c4eb-43e4-b8e5-6a5603cdd778 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 23227 microversion: 2.1 time: 0.109762 Jan 11 03:58:25.285909 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 98/180] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:25 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 23227 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:25.661701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:25.662320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:25.673992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.674486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:25.675257 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.675728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:25.796387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-255125756", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "7c3b392c-7bdf-40a2-b1a9-2f3039d2829a"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:25.827463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:25.846216 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2b124fef-874f-4e90-ab54-1f6526542421 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.187996 Jan 11 03:58:25.847244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 83/181] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:25 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:25.871958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] validate_networks() for [('7c3b392c-7bdf-40a2-b1a9-2f3039d2829a', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:25.939238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:25.939872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:25.952852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.953477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:25.955084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:25.957982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.051813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e5c520f83547d99176925eff449676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10880d10cb47487ab3ae887456176c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:26.061963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63d5f99e-758f-47b2-a05e-0fc7d21c2584 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 200 len: 1346 microversion: 2.1 time: 0.129560 Jan 11 03:58:26.062740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 84/182] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:25 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:26.297070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:26.298094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:26.303626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:26.303807 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.304250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.304358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:26.304902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:26.305031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.305448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.305888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:26.306499 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:26.320145 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.320664 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.321543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.322586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.344998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:26.349366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for user 4dcd5f80a739403ab7577cc398ba0754 and project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:26.360865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:26.364350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:26.412764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0a253570-aab3-4637-951f-3823b1a28359 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 23991 microversion: 2.1 time: 0.119375 Jan 11 03:58:26.414249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 85/183] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:26 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 23991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:26.419697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f414a7f7-6d76-4d20-a3c4-e13107508e31 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638335 Jan 11 03:58:26.420514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 99/184] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 03:58:26.430639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bc22f90a-5dcd-4a5f-bff9-d14f1681a167 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:26.431538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bc22f90a-5dcd-4a5f-bff9-d14f1681a167 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:26.500826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bc22f90a-5dcd-4a5f-bff9-d14f1681a167 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:26.508548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bc22f90a-5dcd-4a5f-bff9-d14f1681a167 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1217 microversion: 2.1 time: 0.082018 Jan 11 03:58:26.518925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-16c165d2-585c-4b74-9a83-e7f2ce2f30bb req-e60daab5-dc0c-4bea-a1ef-218181146684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2811bcc-8a93-44d0-8fca-057f8f1bcff0", "name": "network-vif-plugged", "status": "completed", "tag": "d557758e-9e23-4e41-9077-811c8f235c2a"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:26.520646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:26.520646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:58:26.524813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 86/185] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:26 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:26.535097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-16c165d2-585c-4b74-9a83-e7f2ce2f30bb req-e60daab5-dc0c-4bea-a1ef-218181146684 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.535751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-16c165d2-585c-4b74-9a83-e7f2ce2f30bb req-e60daab5-dc0c-4bea-a1ef-218181146684 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.548840 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-16c165d2-585c-4b74-9a83-e7f2ce2f30bb req-e60daab5-dc0c-4bea-a1ef-218181146684 service nova] Creating event network-vif-plugged:d557758e-9e23-4e41-9077-811c8f235c2a for instance d2811bcc-8a93-44d0-8fca-057f8f1bcff0 on hv-cinder-81977 Jan 11 03:58:26.555575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-16c165d2-585c-4b74-9a83-e7f2ce2f30bb req-e60daab5-dc0c-4bea-a1ef-218181146684 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041658 Jan 11 03:58:26.556582 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 100/186] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:58:26.863455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:26.864060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:26.870750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.871241 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.872025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:26.872464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:26.997862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:27.005184 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bb3eddbc-a711-4c65-9c07-fe162710c502 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.145382 Jan 11 03:58:27.005749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 87/187] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:26 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:27.079355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:27.080053 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:27.086146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.086592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.087361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.087795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.101019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] HTTP exception thrown: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. Jan 11 03:58:27.101590 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Returning 404 to user: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:27.102441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f43108e7-7bd8-4604-8a37-55234b86bdb3 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 404 len: 111 microversion: 2.1 time: 0.028057 Jan 11 03:58:27.102954 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 101/188] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:27 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:58:27.198928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:27.199839 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:27.206685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.207136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.207916 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.208353 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.220451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] HTTP exception thrown: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. Jan 11 03:58:27.221027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Returning 404 to user: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:27.221868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a27cade3-87fd-4bfb-add5-30b505a278d4 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026709 Jan 11 03:58:27.222392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 88/189] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:58:27 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:58:27.424289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:27.425240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:27.431125 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.431800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.432591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.433027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.525220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:27.525790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:27.532235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.532687 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.533461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:27.533926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:27.600022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:27.607277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a78d8153-03fa-4806-82c2-e41f0ecd9569 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1221 microversion: 2.1 time: 0.085787 Jan 11 03:58:27.608332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 89/190] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:27 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:28.021870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:28.022489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:28.028556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:28.029006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:28.029863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:28.030301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:28.153562 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:28.160868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ad5af1fe-dc63-4343-8965-84813b2b0ea1 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.142584 Jan 11 03:58:28.161427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 90/191] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:28 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:28.625048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:28.625582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:28.631359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:28.631811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:28.632594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:28.633032 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:28.689561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:28.696902 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fef4892e-ae8b-4190-a9a4-d4fbef2e7916 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1221 microversion: 2.1 time: 0.076191 Jan 11 03:58:28.697461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 91/192] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:28 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:29.176877 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:29.177719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:29.183750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:29.184203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:29.184985 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:29.185422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:29.313854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:29.321307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-95d661d4-ba13-4a81-996c-2c642b043f80 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.148227 Jan 11 03:58:29.321951 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 92/193] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:29 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:29.716162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:29.717423 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:29.725385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:29.725871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:29.726654 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:29.727245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:29.786356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:29.793497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-35bae0da-49ff-431c-b91d-dbcc2a224a81 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1221 microversion: 2.1 time: 0.083888 Jan 11 03:58:29.794096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 93/194] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:29 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:30.338282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:30.338967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:30.345224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:30.345690 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:30.346488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:30.346907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:30.475893 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:30.483180 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-294ecbd8-ca6e-4070-a2a4-f9a376928b70 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.148520 Jan 11 03:58:30.483747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 94/195] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:30 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:30.810417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:30.811651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:30.817419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:30.817898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:30.818671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:30.819106 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:30.874997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:30.882196 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f1871ce8-209e-4f8e-93b5-93ced106fbb2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1221 microversion: 2.1 time: 0.075416 Jan 11 03:58:30.882752 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 95/196] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:30 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:31.063194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-92337e8a-9042-45e3-8410-635f2102245e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 27714 microversion: 2.1 time: 3.642564 Jan 11 03:58:31.064574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 102/197] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:27 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 27714 bytes in 3644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:31.507489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:31.507489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:31.510648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:31.511170 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:31.512140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:31.512638 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:31.643942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:31.651073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-498fb668-4b30-4621-8a5d-260415153c7c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.155208 Jan 11 03:58:31.651640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 96/198] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:31 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:31.899434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:31.900527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:31.908317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:31.908761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:31.909562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:31.910421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:31.989290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:31.999391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e8fc36d5-fec3-49f8-a650-f790a535eea7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1269 microversion: 2.1 time: 0.104058 Jan 11 03:58:32.000103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 103/199] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:31 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:32.074330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:32.075447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:32.081812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:32.082260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:32.083221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:32.083812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:32.428201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-dfd0e56c-20d0-4d08-b305-dbc9edea2da6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 27815 microversion: 2.1 time: 0.357256 Jan 11 03:58:32.429793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 97/200] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:32 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 27815 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:32.667932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:32.668564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:32.674723 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:32.675166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:32.675928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:32.676358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:32.801438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:32.809141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-33b5c1c3-e7ca-4610-b3c0-6233ad736274 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.144826 Jan 11 03:58:32.809739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 104/201] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:32 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:33.017046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:33.017783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:33.024552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.024999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:33.025803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.026243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:33.084868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:33.093083 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d5174a16-ad48-41f7-aee7-cd024d1ff8df tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1275 microversion: 2.1 time: 0.080526 Jan 11 03:58:33.093637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 98/202] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:33 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:33.439800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:33.440804 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:33.446979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.447429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:33.448197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.448625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:33.826093 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:33.827205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:33.834488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.835035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:33.836022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:33.836513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:34.029543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:34.036722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c9fc1dd7-2116-48b2-9ddf-f9668b85d2db tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.214294 Jan 11 03:58:34.037290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 99/203] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:33 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:34.109287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:34.109921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:34.115538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:34.116008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:34.116767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:34.117205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:34.432588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:34.440321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7e4aa4ea-dd0e-4f5a-a63a-c2e085650d20 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.334500 Jan 11 03:58:34.440887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 100/204] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:34 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:35.052179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:35.052793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:35.059082 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:35.059532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:35.060309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:35.061321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:35.325424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:35.333300 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-94d233d3-7764-47e4-9844-a988456ee101 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.284731 Jan 11 03:58:35.333891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 101/205] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:35 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:35.457174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:35.457764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:35.463544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:35.463994 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:35.464770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:35.465207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:35.594207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:35.601321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d548084e-4917-49e7-9765-25c6e4c0b210 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.147745 Jan 11 03:58:35.601900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 102/206] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:35 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:36.350944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:36.351557 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:36.357418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:36.358408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:36.359184 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:36.359616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:36.485878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:36.493096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d90a5eb9-a95e-4b9b-9e5e-a81083a640e4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.146530 Jan 11 03:58:36.493652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 103/207] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:36 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:36.617264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:36.617911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:36.623661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:36.624110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:36.624882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:36.625450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:36.753245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:36.760385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cc708439-0e88-4167-83d7-eaae136835c9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.147012 Jan 11 03:58:36.760949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 104/208] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:36 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:37.510016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:37.510663 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:37.519536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:37.520225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:37.521196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2d1b1a95-9c04-4b8c-849f-5f0e04571c32 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 27815 microversion: 2.1 time: 4.084316 Jan 11 03:58:37.521890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 105/209] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:33 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 27815 bytes in 4087 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:37.525273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:37.525273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:37.777722 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:37.778971 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:37.787225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:37.787817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:37.788626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:37.789052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:37.791326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:37.799612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-aaf7190e-e076-475f-9434-26e931a26137 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.293502 Jan 11 03:58:37.800181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 105/210] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:37 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:38.017619 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:38.024739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3e4b49a1-d806-4e6f-99ff-819138644147 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.250959 Jan 11 03:58:38.025302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 106/211] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:37 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:38.218747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-08141b15-4336-4adb-ae17-866909d4fdfd req-7c4dc0dd-e227-4ab7-a62a-e79e0ff02e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0ced3c-faf4-4d73-b902-1ef3ac691e95", "tag": "d4f8259b-4d3a-4936-a0d2-6e73645429bd"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:38.220310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:38.220310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:58:38.226990 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-08141b15-4336-4adb-ae17-866909d4fdfd req-7c4dc0dd-e227-4ab7-a62a-e79e0ff02e3e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:38.227434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-08141b15-4336-4adb-ae17-866909d4fdfd req-7c4dc0dd-e227-4ab7-a62a-e79e0ff02e3e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:38.238621 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-08141b15-4336-4adb-ae17-866909d4fdfd req-7c4dc0dd-e227-4ab7-a62a-e79e0ff02e3e service nova] Creating event network-changed:d4f8259b-4d3a-4936-a0d2-6e73645429bd for instance fa0ced3c-faf4-4d73-b902-1ef3ac691e95 on hv-cinder-81977 Jan 11 03:58:38.243556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-08141b15-4336-4adb-ae17-866909d4fdfd req-7c4dc0dd-e227-4ab7-a62a-e79e0ff02e3e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028896 Jan 11 03:58:38.244148 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 106/212] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:58:38.533097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:38.534048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:38.540357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:38.540809 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:38.541588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:38.542048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:38.685425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2134d261-09cb-4606-a0d9-32c9c6ba914f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 27815 microversion: 2.1 time: 0.156233 Jan 11 03:58:38.690948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 107/213] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:38 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 27815 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:38.817379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:38.818231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:38.824749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:38.825229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:38.826590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:38.827029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:38.987401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:38.994698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5e49e426-36ba-4ea4-bd53-dde4dcbae995 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1314 microversion: 2.1 time: 0.182041 Jan 11 03:58:38.995270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 107/214] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:38 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:39.042557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:39.043504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:39.051017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.051469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.052264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.052705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.267338 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:39.276938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c2c752de-c8ca-4348-a3d8-90cb5e3973d6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.238255 Jan 11 03:58:39.277543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 108/215] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:39 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:39.702277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:39.703150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:39.709217 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.709686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.710493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.710924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.826129 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cb8d14a2-9f35-45b7-a2a5-39ac0b98fd9e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 27993 microversion: 2.1 time: 0.127341 Jan 11 03:58:39.827286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 108/216] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:39 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 27993 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:39.953894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:39.954960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:39.961482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.962110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.963115 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:39.963765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:39.979632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] HTTP exception thrown: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. Jan 11 03:58:39.980225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Returning 404 to user: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:39.981039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a8bf69a7-009d-4168-9d8c-d8e63639d3bd tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 404 len: 111 microversion: 2.1 time: 0.030921 Jan 11 03:58:39.981856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 109/217] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 03:58:39 2022] DELETE /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 03:58:39.990584 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:39.991288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] [instance: 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:39.999588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.000074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.000830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.001266 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.012077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:40.013002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:40.017798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] HTTP exception thrown: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. Jan 11 03:58:40.018393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] Returning 404 to user: Instance 37e5e3e3-d66c-4a1d-9617-e9fce9b441fa could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:40.019215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a39539b1-fff4-45df-9a29-7ad84348db16 tempest-DeleteServersTestJSON-1163049235 tempest-DeleteServersTestJSON-1163049235-project] 10.222.0.24 "GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa" status: 404 len: 111 microversion: 2.1 time: 0.032728 Jan 11 03:58:40.019769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 109/218] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:39 2022] GET /compute/v2.1/servers/37e5e3e3-d66c-4a1d-9617-e9fce9b441fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:58:40.020970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.021430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.022489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.023021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.173984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:40.182192 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-76d40ae9-ebaa-4cc7-ac5a-9a8b754ec69f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1498 microversion: 2.1 time: 0.173797 Jan 11 03:58:40.182776 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 110/219] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:40 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:40.295894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:40.298661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:40.307601 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.308685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.309784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.310500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.608488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:40.626717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b7f483aa-334b-40b9-88fa-6ad15aeb7026 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.336308 Jan 11 03:58:40.636422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 110/220] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:40 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:40.723685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:40.724798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:40.735032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.735665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.736542 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.737182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.784474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 03:58:40.837777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:40.838788 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:40.846229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.849483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.850677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:40.852147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:40.982453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-291e7e6c-a326-4932-a8cf-58e9481ab143 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 204 len: 0 microversion: 2.1 time: 0.262593 Jan 11 03:58:40.983635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 111/221] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 03:58:40 2022] DELETE /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 03:58:40.998945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-72a82bfd-9ea2-4477-870e-7573e920fe17 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.163984 Jan 11 03:58:40.999675 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 111/222] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:40 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:41.007006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:41.007722 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:41.015837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:41.016295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:41.017118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:41.017755 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:41.204600 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:41.213419 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0a70d26d-b6dc-453d-a3ca-94af1859a354 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1504 microversion: 2.1 time: 0.224815 Jan 11 03:58:41.218165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 112/223] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:40 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:41.644647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:41.645492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:41.652656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:41.653549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:41.654435 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:41.654960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:41.848342 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:41.865765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1fe8bdc0-9a39-408e-ab58-d10523c959b3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.225828 Jan 11 03:58:41.866639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 112/224] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:41 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:42.011055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:42.012044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:42.022720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.023166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:42.023956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.024391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:42.140661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-70226161-4d1c-436e-aba1-149bf590cb8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.133618 Jan 11 03:58:42.142077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 113/225] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:42 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:42.235895 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:42.236540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:42.243171 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.243813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:42.244754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.245336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:42.385647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:42.393371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-28e74935-d9b6-4c26-a91e-a5ae825be25c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1504 microversion: 2.1 time: 0.161724 Jan 11 03:58:42.393972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 113/226] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:42 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:42.883978 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:42.885052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:42.893401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.894256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:42.895924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:42.896587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.141362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:43.151677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-624071ab-02a2-430b-ab12-442ea2f23962 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.272234 Jan 11 03:58:43.152548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 114/227] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:42 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:43.153996 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:43.154936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:43.162425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:43.163082 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.164150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:43.164736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.267596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2ff5119f-bfd0-4bca-8ada-4586d1f99bb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.117552 Jan 11 03:58:43.273138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 114/228] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:43 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:43.415330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:43.417805 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:43.429825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:43.430817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.432324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:43.433256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.539095 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-024f675e-e59e-49ab-a263-31850f6a8560 req-6af98e9a-921c-4805-a84c-5f596a7cafce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2811bcc-8a93-44d0-8fca-057f8f1bcff0", "name": "network-vif-deleted", "tag": "d557758e-9e23-4e41-9077-811c8f235c2a"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:43.540605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:43.540605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:58:43.556204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-024f675e-e59e-49ab-a263-31850f6a8560 req-6af98e9a-921c-4805-a84c-5f596a7cafce service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:43.556651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-024f675e-e59e-49ab-a263-31850f6a8560 req-6af98e9a-921c-4805-a84c-5f596a7cafce service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:43.585705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:43.589441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-024f675e-e59e-49ab-a263-31850f6a8560 req-6af98e9a-921c-4805-a84c-5f596a7cafce service nova] Creating event network-vif-deleted:d557758e-9e23-4e41-9077-811c8f235c2a for instance d2811bcc-8a93-44d0-8fca-057f8f1bcff0 on hv-cinder-81977 Jan 11 03:58:43.595216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8e29dc2d-c077-43cf-ba31-744aa2df5fc4 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 200 len: 1462 microversion: 2.1 time: 0.188912 Jan 11 03:58:43.597146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 115/229] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:43 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 1462 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:43.597451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-024f675e-e59e-49ab-a263-31850f6a8560 req-6af98e9a-921c-4805-a84c-5f596a7cafce service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062304 Jan 11 03:58:43.598088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 115/230] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:58:44.169131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:44.170401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:44.196235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.197610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.202426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.204036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.280860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:44.281909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:44.306501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.306954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.311026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.314982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.480677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a324a940-7a79-439d-a352-f196fc8cae06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.203789 Jan 11 03:58:44.482962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 116/231] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:44 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:44.613518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:44.614431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: d2811bcc-8a93-44d0-8fca-057f8f1bcff0] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:44.621366 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.626810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.629273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:44.629832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:44.675066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] HTTP exception thrown: Instance d2811bcc-8a93-44d0-8fca-057f8f1bcff0 could not be found. Jan 11 03:58:44.676301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Returning 404 to user: Instance d2811bcc-8a93-44d0-8fca-057f8f1bcff0 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:44.679191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-647d616b-679c-4789-ab20-b0090b7c8144 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0" status: 404 len: 111 microversion: 2.1 time: 0.069423 Jan 11 03:58:44.683398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 117/232] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:44 2022] GET /compute/v2.1/servers/d2811bcc-8a93-44d0-8fca-057f8f1bcff0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:58:44.833732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:44.844441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-72c2e7ce-09d9-4540-9cb6-d6101634daa4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.679898 Jan 11 03:58:44.845331 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 116/233] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:44 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:44.899523 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1774908187", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "95cb0cc0-c947-4f16-b117-534294a7eb6c"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:45.003545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] validate_networks() for [('95cb0cc0-c947-4f16-b117-534294a7eb6c', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:45.493121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:45.494694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:45.506682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:45.507579 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:45.508489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:45.509015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:45.699796 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cad0a8d2-4b1e-4f4f-bae1-258c5683ef4c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.210735 Jan 11 03:58:45.701991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 117/234] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:45 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:45.712861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1311369807", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:45.812617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] validate_networks() for None {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:46.326560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:46.326980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:46.327683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:46.328337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:46.328898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:46.356149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.356903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.358042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.358912 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.382017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Getting quotas for project 9aff83f632b449699bbcc263750a7509. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:46.386399 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Getting quotas for user a74c976274f241d090c93adc88b75784 and project 9aff83f632b449699bbcc263750a7509. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:46.399003 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:46.401547 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:46.457969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:46.458489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:46.458834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:46.459240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:46.459649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:46.469801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e6e66ec5-f76f-42b6-a0f0-4d75669f4e24 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766212 Jan 11 03:58:46.470451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 118/235] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:58:46.476075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.476534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.478145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.478597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.486380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:46.487036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:46.495990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.497050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.498829 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:46.499924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:46.532964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Getting quotas for project accdf5658e784e44844fe761d25869c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:46.537358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Getting quotas for user 56fc15f4739f493bba82a3cb72a20fa3 and project accdf5658e784e44844fe761d25869c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:46.565915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:46.568249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:46.690116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bbe1ed6d-4c14-4a29-8e39-5f96cc0f4dfb tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796215 Jan 11 03:58:46.692434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 118/236] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:58:46.697352 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5c1be419-fe1e-453b-a871-5d023f6dcac5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:46.698000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5c1be419-fe1e-453b-a871-5d023f6dcac5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:46.907149 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5c1be419-fe1e-453b-a871-5d023f6dcac5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:46.919506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5c1be419-fe1e-453b-a871-5d023f6dcac5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1215 microversion: 2.1 time: 0.222438 Jan 11 03:58:46.919506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 119/237] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:46 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:46.934904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a87b29db-901f-40e9-9381-0741872225a3 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:46.936328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a87b29db-901f-40e9-9381-0741872225a3 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:47.039212 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a87b29db-901f-40e9-9381-0741872225a3 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:47.047191 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:47.062399 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d408b57c-1eaa-4500-8561-d6c6b7458169 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.585461 Jan 11 03:58:47.064013 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a87b29db-901f-40e9-9381-0741872225a3 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1214 microversion: 2.1 time: 0.143172 Jan 11 03:58:47.066928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 120/238] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:46 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:47.072092 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:47.072795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 119/239] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:46 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:47.074151 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:47.095533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:47.098326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:47.099820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:47.100706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:47.253886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b428c622-fd89-4897-9c9f-aca51616139e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.185172 Jan 11 03:58:47.254465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 121/240] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:47 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:47.863962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-87e75064-f25c-4de9-8bed-436456f75662 req-2ade5237-eea7-4d42-949e-3bfbd559c41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ced3c-faf4-4d73-b902-1ef3ac691e95", "name": "network-vif-plugged", "status": "completed", "tag": "d4f8259b-4d3a-4936-a0d2-6e73645429bd"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:47.866445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:47.866445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:58:47.908348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-87e75064-f25c-4de9-8bed-436456f75662 req-2ade5237-eea7-4d42-949e-3bfbd559c41c service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:47.909959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-87e75064-f25c-4de9-8bed-436456f75662 req-2ade5237-eea7-4d42-949e-3bfbd559c41c service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:47.936589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:47.938015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:47.950645 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:47.951504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:47.952563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:47.953244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:47.964716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-87e75064-f25c-4de9-8bed-436456f75662 req-2ade5237-eea7-4d42-949e-3bfbd559c41c service nova] Creating event network-vif-plugged:d4f8259b-4d3a-4936-a0d2-6e73645429bd for instance fa0ced3c-faf4-4d73-b902-1ef3ac691e95 on hv-cinder-81977 Jan 11 03:58:47.989467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-87e75064-f25c-4de9-8bed-436456f75662 req-2ade5237-eea7-4d42-949e-3bfbd559c41c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126939 Jan 11 03:58:47.991415 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 120/241] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:48.084283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:48.084976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:48.101754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.102236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.103068 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.110432 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.472933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:48.491129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cc74624d-225c-4d90-a3cc-709262039d3c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1266 microversion: 2.1 time: 0.411161 Jan 11 03:58:48.491540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:48.492332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 121/242] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:48 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:48.500047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-477b86a6-f614-4b2e-9ebc-a58f1e759372 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1267 microversion: 2.1 time: 0.569420 Jan 11 03:58:48.510038 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 122/243] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:47 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1267 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:48.515558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:48.516502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:48.521418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:48.523477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:48.533434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.533927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.534733 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.535178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.536647 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.537504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.538672 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:48.551785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:48.666120 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-53d280b0-5b85-4bc2-9f15-f452dbf18c0e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.159574 Jan 11 03:58:48.667029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 123/244] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:48 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:49.370247 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:49.388027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fa474e00-68e0-4e98-b916-c6bee4fe54e9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.892938 Jan 11 03:58:49.389164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 122/245] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:48 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:49.511474 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:49.512180 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:49.519866 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:49.520764 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:49.524290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.530437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.531527 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.532126 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.539512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.539830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.541626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.542249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.641090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:49.650745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-68d7486e-4b89-43d0-8fc1-c374bb8231d0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1272 microversion: 2.1 time: 0.143306 Jan 11 03:58:49.651326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 124/246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:49 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:49.677295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:49.679275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:49.680944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:49.685240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d7b3f295-9b98-4c6f-b330-c029fe31459f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1273 microversion: 2.1 time: 0.171669 Jan 11 03:58:49.696815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.697488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.698628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:49.699210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:49.701131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 123/247] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:49 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:49.846380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-da18b850-756e-4730-b027-baeb27a4f976 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.171618 Jan 11 03:58:49.850243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 125/248] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:49 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:58:50.406462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:50.407022 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:50.420415 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:50.421758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:50.422904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:50.424888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:50.672096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:50.672925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:50.712263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:50.713593 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:50.716725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:50.721758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:51.000026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:51.016175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0211c665-4658-41d5-910a-74258a4e9302 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1272 microversion: 2.1 time: 0.348813 Jan 11 03:58:51.016769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 126/249] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:50 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1272 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:51.021247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:51.031640 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:51.034594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:51.040669 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-151d211e-07eb-4e84-aeb3-433e8c93a48c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1317 microversion: 2.1 time: 0.638293 Jan 11 03:58:51.041776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:51.042237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:51.043077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:51.043506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:51.050719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 124/250] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:50 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:51.057629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:51.059663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:51.083577 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:51.084301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:51.085258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:51.086156 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:51.206994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3ad8aa7f-a46c-41ce-9cad-ef5bc449fee7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.154634 Jan 11 03:58:51.207650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 125/251] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:51 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:51.579890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:51.597498 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2e057c7c-7c2c-45ca-a4d2-99e9d1c75c9f tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.577018 Jan 11 03:58:51.598443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 127/252] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:51 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:52.033064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:52.033820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:52.058994 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:52.059605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:52.067215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.068388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.069624 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.070318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.071860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.073886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.075096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.076348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.546767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:52.573731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e7c6523d-4162-4d59-8a5f-5a5607e3ed51 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1507 microversion: 2.1 time: 0.506823 Jan 11 03:58:52.578105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 128/253] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:52 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:52.596691 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:52.602103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:52.633295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.633408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.639590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.640312 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.722545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:52.734262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d066f186-1eb0-4c46-9795-e1de0143853e tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.704046 Jan 11 03:58:52.741040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 126/254] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:52 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:52.768095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-e2287ec4-ce14-46c0-ab09-1c6de6cea5f5 req-305cea91-47a9-4579-8f39-a8e797d51e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52429ed3-0111-4a66-8657-ea8781028fac", "tag": "06eae956-60c7-4107-9df5-42a3195364be"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:52.768875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:52.768875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:58:52.797211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d3d8c454-58ee-4c4f-aa61-8a1bc105bdb6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.217384 Jan 11 03:58:52.798831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 129/255] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:52 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:52.806566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6861f0a5-a6db-4b18-95f1-eebbd63da93f"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:52.811007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e2287ec4-ce14-46c0-ab09-1c6de6cea5f5 req-305cea91-47a9-4579-8f39-a8e797d51e35 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.817572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:52.818473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e2287ec4-ce14-46c0-ab09-1c6de6cea5f5 req-305cea91-47a9-4579-8f39-a8e797d51e35 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.847920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.848550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.849555 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.850188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.854289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-e2287ec4-ce14-46c0-ab09-1c6de6cea5f5 req-305cea91-47a9-4579-8f39-a8e797d51e35 service nova] Creating event network-changed:06eae956-60c7-4107-9df5-42a3195364be for instance 52429ed3-0111-4a66-8657-ea8781028fac on hv-cinder-81977 Jan 11 03:58:52.869622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-e2287ec4-ce14-46c0-ab09-1c6de6cea5f5 req-305cea91-47a9-4579-8f39-a8e797d51e35 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126534 Jan 11 03:58:52.871836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 127/256] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:52.887401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:52.888166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:52.925215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.928709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:52.929779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:52.933481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.089198 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Invalid volume: volume 6861f0a5-a6db-4b18-95f1-eebbd63da93f is already attached to instances: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 Jan 11 03:58:53.090654 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 400 to user: Invalid volume: volume 6861f0a5-a6db-4b18-95f1-eebbd63da93f is already attached to instances: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:58:53.093724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-61cae89b-1893-4af5-8109-c014db2c6605 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.291762 Jan 11 03:58:53.096571 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 130/257] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 03:58:52 2022] POST /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95/os-volume_attachments => generated 174 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 03:58:53.193892 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:53.194495 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:53.216715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.217151 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.218187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.218814 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.405856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:53.424320 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-66b7cf98-3de9-4067-b98e-7aa5935a25cd tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.547352 Jan 11 03:58:53.428878 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 128/258] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:52 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:53.487773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lazy-loading 'services' on Instance uuid 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 03:58:53.660890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a3a7cc65-3dfa-4767-900a-88dda6f149c3 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments/6861f0a5-a6db-4b18-95f1-eebbd63da93f" status: 202 len: 0 microversion: 2.1 time: 0.471687 Jan 11 03:58:53.669945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:53.671211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:53.676495 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 131/259] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 03:58:53 2022] DELETE /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments/6861f0a5-a6db-4b18-95f1-eebbd63da93f => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 03:58:53.691329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.691927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.704202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.707678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.758081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:53.758947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:53.779836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.782280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.783245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.783794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.807507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5ca4f66c-4c91-4c30-8dc7-710cd5a21c62 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137282 Jan 11 03:58:53.811401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 129/260] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:58:53 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:53.820917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:53.827930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:53.849264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.851773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:53.852605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:53.853045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:54.016943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-117ffa33-68a7-47b7-bd48-8793111ecf1d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28177 microversion: 2.1 time: 0.206962 Jan 11 03:58:54.017801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 130/261] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:53 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28177 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:54.355008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:54.364764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cb120d8c-2835-4169-aecf-4dc68f48985a tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.610730 Jan 11 03:58:54.378529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 132/262] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:53 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:54.445298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:54.446063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:54.459718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:54.461153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:54.462516 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:54.465618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:54.821895 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:54.822900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:54.833811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:54.834266 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:54.837138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:54.838316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:54.839364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:54.858769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-75e1782a-4fcb-4350-8f11-89956f9dd684 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.418852 Jan 11 03:58:54.862243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 131/263] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:54 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:54.954807 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-489dc6f5-59d2-4a9a-979d-c602ea4c6983 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138753 Jan 11 03:58:54.956724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 133/264] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:58:54 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:58:55.031165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:55.032199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:55.047285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.048144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.050983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.051635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.206618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-733b3f51-78a1-4765-9b79-d156a7682202 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28305 microversion: 2.1 time: 0.181466 Jan 11 03:58:55.207522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 132/265] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:55 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:55.397008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:55.413037 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:55.414028 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-c5ae6b38-803e-4876-bdd8-2434547d716e req-c6183d72-fd40-426f-bb84-8ca239be7f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f620db-2c73-4b40-804c-38cc99df1b89", "tag": "dbace5d1-2748-4933-9922-1d776941c007"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:55.422859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:58:55.422859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:58:55.437288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.438518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.439363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.441887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.444920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-c5ae6b38-803e-4876-bdd8-2434547d716e req-c6183d72-fd40-426f-bb84-8ca239be7f1b service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.445921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-c5ae6b38-803e-4876-bdd8-2434547d716e req-c6183d72-fd40-426f-bb84-8ca239be7f1b service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.465892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-c5ae6b38-803e-4876-bdd8-2434547d716e req-c6183d72-fd40-426f-bb84-8ca239be7f1b service nova] Creating event network-changed:dbace5d1-2748-4933-9922-1d776941c007 for instance 19f620db-2c73-4b40-804c-38cc99df1b89 on hv-cinder-81977 Jan 11 03:58:55.472785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-c5ae6b38-803e-4876-bdd8-2434547d716e req-c6183d72-fd40-426f-bb84-8ca239be7f1b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073008 Jan 11 03:58:55.473801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 133/266] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:58:55.680067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:55.689589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-21bd4e4e-ff4b-44db-9275-394ea5a71b8b tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.297187 Jan 11 03:58:55.690195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 134/267] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:55 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:55.878713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:55.879899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:55.890670 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.896920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.898165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.899073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.976215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:55.977138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:55.989602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.990097 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:55.998398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:55.998855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:56.102462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7c1310e5-ec3e-47dd-973f-4b34e75e27a5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129822 Jan 11 03:58:56.103609 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 135/268] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:58:55 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 11 03:58:56.220317 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:56.222198 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:56.244867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:56.245478 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:56.261016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:56.269887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:56.307498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:56.318130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-809d6523-3251-4ce9-88d0-d969f4205964 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.443184 Jan 11 03:58:56.318977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 134/269] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:55 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:56.423907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a4fdfbf2-b71f-4f54-8a9f-dd02f5809a61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28468 microversion: 2.1 time: 0.208048 Jan 11 03:58:56.425154 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 136/270] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:56 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:56.454204 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-395543116", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "7c3b392c-7bdf-40a2-b1a9-2f3039d2829a"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:56.524360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] validate_networks() for [('7c3b392c-7bdf-40a2-b1a9-2f3039d2829a', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:56.728665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:56.729385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:56.736418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:56.737737 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:56.738732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:56.739279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:57.218134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:57.233643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-afac30a9-d305-4387-8b4d-d8c599fff109 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.524753 Jan 11 03:58:57.235869 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 137/271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:56 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:57.336147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:57.337011 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:57.354986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:57.358073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:57.364613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:57.365200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:57.626603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:57.627701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:57.628785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:57.629523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:57.630177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:57.655567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:57.656019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:57.674139 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:57.674573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:57.736123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:57.745902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for user 4dcd5f80a739403ab7577cc398ba0754 and project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:57.803649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:57.824141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:57.992124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c520c272-4095-4ba2-b4c1-d1688796bcb1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.542274 Jan 11 03:58:57.994683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 135/272] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:58:58.117393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:58.129165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0e899295-4923-4566-ab70-0a733ce60a55 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.797115 Jan 11 03:58:58.136257 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 138/273] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:57 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:58.156221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:58.157574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:58.170208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:58.172099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:58.174433 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:58.188009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:58.319872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-623b57e5-3cb7-4413-a83b-84f9530f616e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.181557 Jan 11 03:58:58.321156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 139/274] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:58 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:58.332363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d1180567-1acb-423c-a0fd-1c8f08f7807c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:58.335320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d1180567-1acb-423c-a0fd-1c8f08f7807c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:58.525434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d1180567-1acb-423c-a0fd-1c8f08f7807c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:58.532446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d1180567-1acb-423c-a0fd-1c8f08f7807c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1217 microversion: 2.1 time: 0.208993 Jan 11 03:58:58.550318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 140/275] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:58 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:58.555191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:58.555802 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:58.569128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:58.569869 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:58.570966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:58.571748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:58.587467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-89323401", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65d2596e-dac5-47cc-8694-4f066b07c8df"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:58.717217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] validate_networks() for [('65d2596e-dac5-47cc-8694-4f066b07c8df', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:58:59.106047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:59.115123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9bcc822a-96fb-43ed-aaf6-62ba23fe766c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.563630 Jan 11 03:58:59.118608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 141/276] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:58 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:58:59.152067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:59.153723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:59.164786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.168975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.178686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.182441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.689755 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:58:59.690462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:58:59.691394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:58:59.692081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:58:59.693279 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:58:59.713458 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.716511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.718535 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.720413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.729998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:58:59.756390 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Getting quotas for project 1b52b56248e6442f9eba0935d808ccd5. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:58:59.773224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Getting quotas for user 299933ca0f6c45a38b9099a4a175abb4 and project 1b52b56248e6442f9eba0935d808ccd5. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:58:59.784312 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3ff8c649-294c-4e9e-8da9-e5614f98e9f1 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.634419 Jan 11 03:58:59.786347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 142/277] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:59 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:58:59.791830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:58:59.793316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:59.806091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.807542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.809136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.811137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.818841 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:58:59.821368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:58:59.897305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-09cb5ab0-fafb-4973-8740-8b0a5be1d706 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.898502 Jan 11 03:58:59.902064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 136/278] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:58:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:58:59.908707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:59.910711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:58:59.931626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.932769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.933925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:58:59.934911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:58:59.956518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2db93b87-cc0c-4b44-97ef-bd5761e9bd9a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.168262 Jan 11 03:58:59.960824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 143/279] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:58:59 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:58:59.977294 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-40ab0ca1-e70e-4e09-a577-bb31ef885bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:58:59.979505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-40ab0ca1-e70e-4e09-a577-bb31ef885bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:00.201240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-40ab0ca1-e70e-4e09-a577-bb31ef885bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:00.210193 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-40ab0ca1-e70e-4e09-a577-bb31ef885bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1220 microversion: 2.1 time: 0.249961 Jan 11 03:59:00.210777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 144/280] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:59 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:00.216483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:00.226996 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:00.227545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c24e63c3-8875-45d1-95af-c6f2cdd3f9f5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1287 microversion: 2.1 time: 0.322150 Jan 11 03:59:00.228650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 137/281] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:58:59 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1287 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:00.233354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:00.257220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:00.259210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:00.260029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:00.260481 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:00.352463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1526358710", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65d2596e-dac5-47cc-8694-4f066b07c8df"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:00.451340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] validate_networks() for [('65d2596e-dac5-47cc-8694-4f066b07c8df', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:59:00.775429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:00.789005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1bbb2fc3-d03e-42d7-a1bf-0b602965d1dc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.566389 Jan 11 03:59:00.789941 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 145/282] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:00 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:00.813612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:00.818025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:00.848441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:00.850045 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:00.851828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:00.852791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.144859 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:01.157789 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-33bd08a3-65de-470a-85b1-6e320238d609 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.358785 Jan 11 03:59:01.160842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 146/283] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:00 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:01.173888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:01.177623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:01.198190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.199795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.203278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.204326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.316688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e08f57c8-b457-4b84-a422-98f831f8ef70 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.152626 Jan 11 03:59:01.322308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 147/284] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:01 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:01.331483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:01.332631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:01.341886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.342691 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.344361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.345122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.351290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:59:01.353287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:59:01.354062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:59:01.355105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:59:01.356095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:59:01.371992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.373645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.375056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.376006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.401191 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Getting quotas for project 1b52b56248e6442f9eba0935d808ccd5. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:59:01.405858 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Getting quotas for user 299933ca0f6c45a38b9099a4a175abb4 and project 1b52b56248e6442f9eba0935d808ccd5. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:59:01.421320 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:59:01.423756 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:59:01.529357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-21467070-96c2-4821-9591-d7c04a538ddc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.175700 Jan 11 03:59:01.539416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 138/285] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:59:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 03:59:01.560508 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-caf1284b-ac92-460a-bc7f-44077be257e6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:01.562574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-caf1284b-ac92-460a-bc7f-44077be257e6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:01.766283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-caf1284b-ac92-460a-bc7f-44077be257e6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:01.773000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:01.788702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f335665d-986b-4877-a344-721bd6c52d3b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.463567 Jan 11 03:59:01.790536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 148/286] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:01 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:01.798076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-caf1284b-ac92-460a-bc7f-44077be257e6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1222 microversion: 2.1 time: 0.254755 Jan 11 03:59:01.808480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 139/287] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:01 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1222 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:01.815767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:01.816386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:01.825100 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.826736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:01.829075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:01.831476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.180045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:02.181058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:02.195425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.196323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.197443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.198838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.832318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:02.849031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4572aac2-6c51-432c-ba45-a20a251877bc tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 1.043082 Jan 11 03:59:02.850503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 149/288] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:01 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:02.855884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:02.858834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:02.867292 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.868517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.869606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.870530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.920991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:02.930648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-27c3aba7-6348-41a6-b5fb-5f7923affd28 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.755354 Jan 11 03:59:02.931685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 140/289] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:02 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:02.946501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:02.947111 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:02.969633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.970134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:02.971371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:02.971536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.065362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4419378a-e7b6-4153-a48a-6ef30a84bbe1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.213203 Jan 11 03:59:03.068998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 150/290] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:02 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:03.074741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:03.079683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:03.098731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.100395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.105018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.105708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.355329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:03.370010 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5b0fc04b-3aff-43c1-9e45-9e66e844b9b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1274 microversion: 2.1 time: 0.296134 Jan 11 03:59:03.374559 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 151/291] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:03 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1274 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:03.396541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:03.424151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-524407db-d62f-4c83-a162-bccb522923ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.488245 Jan 11 03:59:03.424797 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 141/292] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:02 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:03.798358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-0bd74086-716c-4e36-9756-e761dd6cfda7 req-be1fc7b3-cebe-42fc-a860-51b6f150f18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a", "tag": "ed1f299c-e5e8-4863-85fb-355b36611b4b"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:03.800183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:03.800183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:03.823883 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0bd74086-716c-4e36-9756-e761dd6cfda7 req-be1fc7b3-cebe-42fc-a860-51b6f150f18f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.825612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0bd74086-716c-4e36-9756-e761dd6cfda7 req-be1fc7b3-cebe-42fc-a860-51b6f150f18f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.840629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-0bd74086-716c-4e36-9756-e761dd6cfda7 req-be1fc7b3-cebe-42fc-a860-51b6f150f18f service nova] Creating event network-changed:ed1f299c-e5e8-4863-85fb-355b36611b4b for instance b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a on hv-cinder-81977 Jan 11 03:59:03.854729 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-0bd74086-716c-4e36-9756-e761dd6cfda7 req-be1fc7b3-cebe-42fc-a860-51b6f150f18f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057544 Jan 11 03:59:03.855594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 152/293] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:03.867131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:03.867674 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:03.884222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.884861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.885917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.886436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.952853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:03.953573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:03.973345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.973834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:03.974687 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:03.975094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.640879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:04.654193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d4154e90-d8bd-4125-935f-2342c0e37972 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.788591 Jan 11 03:59:04.655971 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 142/294] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:03 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:04.667761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:04.668802 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:04.691178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.692356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.693787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.698891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.752611 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:04.761001 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6309642a-f7dc-4c2c-8f57-36f9fe14641e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.813728 Jan 11 03:59:04.764583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 153/295] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:03 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:04.769465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:04.770261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:04.776780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.777459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.779273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.779900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.836821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1149cce6-fa39-415c-b21b-7242b9bee79a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.177610 Jan 11 03:59:04.838214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 143/296] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:04 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:04.849639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:04.852425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:04.872661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.875226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:04.878365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:04.886423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:05.190505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:05.218901 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6f0bdc6c-829f-4d51-85ce-8c7a5c56f873 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1280 microversion: 2.1 time: 0.452934 Jan 11 03:59:05.231013 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 154/297] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:04 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1280 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:05.235347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-516d72c1-6866-426f-a2bb-8a9ef7d5d577 req-a8c9048f-e522-412a-b596-d4c84e33c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f620db-2c73-4b40-804c-38cc99df1b89", "name": "network-vif-plugged", "status": "completed", "tag": "dbace5d1-2748-4933-9922-1d776941c007"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:05.237048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:05.237048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:05.256706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-516d72c1-6866-426f-a2bb-8a9ef7d5d577 req-a8c9048f-e522-412a-b596-d4c84e33c4f5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:05.258137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-516d72c1-6866-426f-a2bb-8a9ef7d5d577 req-a8c9048f-e522-412a-b596-d4c84e33c4f5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:05.275879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-516d72c1-6866-426f-a2bb-8a9ef7d5d577 req-a8c9048f-e522-412a-b596-d4c84e33c4f5 service nova] Creating event network-vif-plugged:dbace5d1-2748-4933-9922-1d776941c007 for instance 19f620db-2c73-4b40-804c-38cc99df1b89 on hv-cinder-81977 Jan 11 03:59:05.283945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-516d72c1-6866-426f-a2bb-8a9ef7d5d577 req-a8c9048f-e522-412a-b596-d4c84e33c4f5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058017 Jan 11 03:59:05.284688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 155/298] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:05.417523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:05.427453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c5fb64e9-dcc5-4023-b2e9-d64083976095 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.587329 Jan 11 03:59:05.429375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 144/299] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:04 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:05.674135 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:05.675400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:05.685984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:05.686693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:05.687671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:05.688260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:05.783377 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:05.786219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:05.802752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:05.803576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:05.806381 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:05.808569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.223243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:06.236880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-79936b8e-f720-4a31-bd36-5338f4e8d1a7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.567564 Jan 11 03:59:06.237823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 156/300] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:05 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:06.243331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:06.244497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:06.252239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.253086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.255205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.255890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.342993 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:06.352182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7783ed21-7bba-4b87-a116-bdef089bbd4e tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.573985 Jan 11 03:59:06.352778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 145/301] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:05 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:06.371111 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:06.371739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:06.382929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-83cab182-75fd-4799-9201-5a9edc3902b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.143569 Jan 11 03:59:06.386660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 157/302] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:06 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:06.387479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.388004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.388812 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.389251 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.460026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:06.461126 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:06.484865 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.486232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.487952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:06.488649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:06.860613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:06.869412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5e1285c4-a9f0-4e43-a277-69a5b1c45ba5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.512921 Jan 11 03:59:06.870314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 146/303] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:06 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:06.968283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:06.976821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-be5cd779-adfa-48c9-a813-5d7ff61ddcfc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.524984 Jan 11 03:59:06.977410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 158/304] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:06 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:07.125553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-fb1898b1-c2b7-4ec1-84c9-a5fe811abef4 req-bc6eecfc-37a8-4e6e-b030-9ef96d02cb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "376b0310-ef7d-4609-ba47-c79f9805555b", "tag": "6aa178e1-0846-40fa-8f5f-6f757faea583"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:07.128549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:07.128549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:07.135781 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-fb1898b1-c2b7-4ec1-84c9-a5fe811abef4 req-bc6eecfc-37a8-4e6e-b030-9ef96d02cb03 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.136486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-fb1898b1-c2b7-4ec1-84c9-a5fe811abef4 req-bc6eecfc-37a8-4e6e-b030-9ef96d02cb03 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.155732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-fb1898b1-c2b7-4ec1-84c9-a5fe811abef4 req-bc6eecfc-37a8-4e6e-b030-9ef96d02cb03 service nova] Creating event network-changed:6aa178e1-0846-40fa-8f5f-6f757faea583 for instance 376b0310-ef7d-4609-ba47-c79f9805555b on hv-cinder-81977 Jan 11 03:59:07.162859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-fb1898b1-c2b7-4ec1-84c9-a5fe811abef4 req-bc6eecfc-37a8-4e6e-b030-9ef96d02cb03 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040771 Jan 11 03:59:07.164859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 147/305] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:07.254346 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:07.254856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:07.261993 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.263861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.264689 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.265374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.300154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-8663e32b-97b1-4edd-976b-60547de67209 req-7a69996d-1875-4f5f-9731-2da85dedfa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52429ed3-0111-4a66-8657-ea8781028fac", "name": "network-vif-plugged", "status": "completed", "tag": "06eae956-60c7-4107-9df5-42a3195364be"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:07.302186 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:07.302186 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:07.312577 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-8663e32b-97b1-4edd-976b-60547de67209 req-7a69996d-1875-4f5f-9731-2da85dedfa1e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.313370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-8663e32b-97b1-4edd-976b-60547de67209 req-7a69996d-1875-4f5f-9731-2da85dedfa1e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.327301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-8663e32b-97b1-4edd-976b-60547de67209 req-7a69996d-1875-4f5f-9731-2da85dedfa1e service nova] Creating event network-vif-plugged:06eae956-60c7-4107-9df5-42a3195364be for instance 52429ed3-0111-4a66-8657-ea8781028fac on hv-cinder-81977 Jan 11 03:59:07.333212 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-8663e32b-97b1-4edd-976b-60547de67209 req-7a69996d-1875-4f5f-9731-2da85dedfa1e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037403 Jan 11 03:59:07.333777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 148/306] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:59:07.371046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:07.372767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:07.380567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.381187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.382173 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:07.382760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:07.971241 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:07.985635 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d0917e20-71a5-47c6-9b26-953dc3791804 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1314 microversion: 2.1 time: 0.733938 Jan 11 03:59:08.000178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 159/307] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:07 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:08.000178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:08.003613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:08.008412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:08.021324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a0478560-9431-423a-b1c0-c2d4692189b5 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.654542 Jan 11 03:59:08.024250 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 149/308] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:07 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:08.037254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:08.039834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:08.048367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.048817 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.052037 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.052655 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.058627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.059066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.060481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.060865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.299684 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0bc3de34-9a5f-479e-bb26-2c1fdcb706f1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.305912 Jan 11 03:59:08.300741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 160/309] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:07 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:08.305869 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:08.306777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:08.315051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.315773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.316765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:08.317392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:08.367556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:08.376464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b9bd0e9f-8cd3-40e2-a982-a6a0f1d193fe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.349679 Jan 11 03:59:08.386755 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 150/310] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:08 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:08.677140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:08.689311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c38d0086-5860-44a0-9605-236370c84dc0 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.387132 Jan 11 03:59:08.693934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 161/311] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:08 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:09.008024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:09.009230 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:09.023349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.023768 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.025201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.025825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.040324 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:09.041351 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:09.059135 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.059661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.060524 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.060964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.493724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:09.501787 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-92108418-3a6a-431c-a2a7-221699690884 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1315 microversion: 2.1 time: 0.465112 Jan 11 03:59:09.502369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 162/312] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:09 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:09.523627 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-358b5a45-56bd-4831-ad29-7591fea066d1 req-bac434c0-8aa1-44b5-bfef-3f84e4c4fc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84501321-d633-43bb-9f6c-8802aefa5bd6", "tag": "2364fafc-197f-40d7-997d-ccc1075bbf00"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:09.533585 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:09.533585 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:09.556055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-358b5a45-56bd-4831-ad29-7591fea066d1 req-bac434c0-8aa1-44b5-bfef-3f84e4c4fc28 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.556723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-358b5a45-56bd-4831-ad29-7591fea066d1 req-bac434c0-8aa1-44b5-bfef-3f84e4c4fc28 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.595798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-358b5a45-56bd-4831-ad29-7591fea066d1 req-bac434c0-8aa1-44b5-bfef-3f84e4c4fc28 service nova] Creating event network-changed:2364fafc-197f-40d7-997d-ccc1075bbf00 for instance 84501321-d633-43bb-9f6c-8802aefa5bd6 on hv-cinder-81977 Jan 11 03:59:09.609421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:09.613424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-358b5a45-56bd-4831-ad29-7591fea066d1 req-bac434c0-8aa1-44b5-bfef-3f84e4c4fc28 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098249 Jan 11 03:59:09.618009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 163/313] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:09.620716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1d52a727-867c-4939-a696-9b655eaa7d4d tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1497 microversion: 2.1 time: 0.614916 Jan 11 03:59:09.626673 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 151/314] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:09 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1497 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:09.631834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:09.632775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:09.638262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:09.639517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:09.654827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.655287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.656088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.660106 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.673974 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.675674 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.677790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.682318 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.859294 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e406ea66-b841-4653-b48f-4f1c6023d6d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.239534 Jan 11 03:59:09.860870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 164/315] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:09 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:09.866798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:09.871521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:09.889243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.889728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:09.890546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:09.890983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.370753 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:10.379583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-499f2f24-ed80-42b6-89ec-d729a87ca805 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.751549 Jan 11 03:59:10.380161 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 152/316] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:09 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:10.398882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:10.399680 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:10.410635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.411326 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.412378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.413123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.484672 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 03:59:10.520014 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:10.533491 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-02c9b955-94ae-44c8-a8fa-5e9d6c2b1407 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.670617 Jan 11 03:59:10.534244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 165/317] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:09 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:10.564414 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:10.565167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:10.583763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.584249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.585240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.586017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.618761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9846bcd3-b7d9-49ea-95d2-7392dad80d8c tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "DELETE /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 204 len: 0 microversion: 2.1 time: 0.220728 Jan 11 03:59:10.620853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 153/318] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 03:59:10 2022] DELETE /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 03:59:10.633600 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:10.638718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:10.654217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.657627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:10.658483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:10.658920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.074813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:11.083461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:11.084671 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-849afd0e-ad3d-4e74-ae79-4e00496d8eb0 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1503 microversion: 2.1 time: 0.455002 Jan 11 03:59:11.094661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 154/319] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:10 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:11.100706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:11.101518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:11.107321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d5547eca-869d-4057-ba28-11077289e2b2 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1465 microversion: 2.1 time: 0.555924 Jan 11 03:59:11.107548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.108227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.109380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.110078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.131244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 166/320] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:10 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1465 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:11.155002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:11.155818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:11.173697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.174507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.175617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.175948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.226245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 03:59:11.337985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-22962807-44de-40d0-9e5f-3c034d30dd00 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.250023 Jan 11 03:59:11.339671 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 155/321] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:11 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:11.342683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ee7efa87-2825-476a-842a-7aed12b4f536 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "DELETE /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 204 len: 0 microversion: 2.1 time: 0.192073 Jan 11 03:59:11.344447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 167/322] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 03:59:11 2022] DELETE /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 03:59:11.354794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:11.355900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:11.365061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.366226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.367745 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.369392 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.396512 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:11.397334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:11.404700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.406962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.408296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.410039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.628196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:11.636538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2c330289-ed97-4b5d-9e10-b81068ddb5a8 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1471 microversion: 2.1 time: 0.287563 Jan 11 03:59:11.642189 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 156/323] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:11 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:11.649237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:11.655592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:11.665620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:11.666550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.667011 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.667819 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:11.668256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:11.676244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0c86e34f-4e0c-4830-9800-4b16b945b17b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.283591 Jan 11 03:59:11.677139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 168/324] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:11 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:11.859170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:11.867644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-91f2d1cd-a5e1-4152-a8ad-c563d2e18842 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.222097 Jan 11 03:59:11.878106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 157/325] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:11 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:12.103765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:12.104716 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:12.111388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.114075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.118359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.119113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.272022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:12.294643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fec8db30-cd31-4174-a477-ea0bf4cd5add tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1503 microversion: 2.1 time: 0.195396 Jan 11 03:59:12.295236 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 169/326] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:12 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:12.351323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:12.351973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:12.358773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.359230 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.360051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.360491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.555094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a0edcbef-2e0f-497c-aadb-7f75b4e0cd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.207678 Jan 11 03:59:12.556176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 158/327] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:12 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:12.658295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:12.659005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:12.664871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.665586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.666744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.667504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.696360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:12.697765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:12.705177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.705618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.706447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.706867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.899161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:12.907376 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6a1f6dd4-c7ef-4220-92a7-0c0f5f17813a tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1471 microversion: 2.1 time: 0.252801 Jan 11 03:59:12.917348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 170/328] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:12 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:12.922910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:12.923816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:12.930757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.931470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:12.932425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:12.933012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.014383 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:13.026617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5625732b-ea2a-48cd-a974-6303e0cffc45 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.336189 Jan 11 03:59:13.038682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 159/329] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:12 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:13.194603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:13.204099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b3dd3ded-dbde-49a3-b2df-9bb08f152f22 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.285233 Jan 11 03:59:13.204828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 171/330] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:12 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:13.312250 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:13.313144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:13.326631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.327332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.328147 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.328591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.567910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:13.568906 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:13.575488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.575676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.576443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.576892 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.629748 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56fc15f4739f493bba82a3cb72a20fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accdf5658e784e44844fe761d25869c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:13.655537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b455b9f0-1428-4ea4-9d99-8028a7f2510f tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 200 len: 1503 microversion: 2.1 time: 0.346312 Jan 11 03:59:13.657652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 160/331] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:13 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:13.662268 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-0995cb6d-7fff-47c7-ad0f-9d0399a77981 req-5d5fdf8a-1f54-4e67-9c50-5c8986730045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f620db-2c73-4b40-804c-38cc99df1b89", "name": "network-vif-deleted", "tag": "dbace5d1-2748-4933-9922-1d776941c007"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:13.664118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:13.664118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:13.673114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-0995cb6d-7fff-47c7-ad0f-9d0399a77981 req-5d5fdf8a-1f54-4e67-9c50-5c8986730045 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.673557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-0995cb6d-7fff-47c7-ad0f-9d0399a77981 req-5d5fdf8a-1f54-4e67-9c50-5c8986730045 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.685899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-0995cb6d-7fff-47c7-ad0f-9d0399a77981 req-5d5fdf8a-1f54-4e67-9c50-5c8986730045 service nova] Creating event network-vif-deleted:dbace5d1-2748-4933-9922-1d776941c007 for instance 19f620db-2c73-4b40-804c-38cc99df1b89 on hv-cinder-81977 Jan 11 03:59:13.691091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-0995cb6d-7fff-47c7-ad0f-9d0399a77981 req-5d5fdf8a-1f54-4e67-9c50-5c8986730045 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Jan 11 03:59:13.694572 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 161/332] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:13.780710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b36129cf-4a22-4e21-9f7a-ba4a853f8a45 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.216256 Jan 11 03:59:13.785088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 172/333] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:13 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:13.924980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:13.925708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:13.940005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.940522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.941381 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.942308 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:13.980342 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-35767f59-4c8d-4296-9207-7c295c863b1e req-07ddfaa6-d96f-49bc-84e1-2656c0b70c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a", "name": "network-vif-plugged", "status": "completed", "tag": "ed1f299c-e5e8-4863-85fb-355b36611b4b"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:13.982558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:13.982558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:13.992891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-35767f59-4c8d-4296-9207-7c295c863b1e req-07ddfaa6-d96f-49bc-84e1-2656c0b70c15 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:13.993699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-35767f59-4c8d-4296-9207-7c295c863b1e req-07ddfaa6-d96f-49bc-84e1-2656c0b70c15 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.009295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-35767f59-4c8d-4296-9207-7c295c863b1e req-07ddfaa6-d96f-49bc-84e1-2656c0b70c15 service nova] Creating event network-vif-plugged:ed1f299c-e5e8-4863-85fb-355b36611b4b for instance b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a on hv-cinder-81977 Jan 11 03:59:14.016592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-35767f59-4c8d-4296-9207-7c295c863b1e req-07ddfaa6-d96f-49bc-84e1-2656c0b70c15 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041559 Jan 11 03:59:14.017903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 173/334] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:14.051699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:14.052941 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:14.093670 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.094588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.096256 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.096936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.667963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:14.681327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5161ef05-6f8e-4818-ad67-c870eee4f371 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1471 microversion: 2.1 time: 0.760566 Jan 11 03:59:14.692337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 162/335] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:13 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:14.697696 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:14.698678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:14.705654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.706922 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.708085 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.708751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.717377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:14.724585 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0068476f-d1ed-4550-b412-7e2df68553dc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.680698 Jan 11 03:59:14.725352 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 174/336] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:14 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:14.735447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:14.737580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] [instance: 19f620db-2c73-4b40-804c-38cc99df1b89] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:14.753214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.753963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.754819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.755429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.777852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] HTTP exception thrown: Instance 19f620db-2c73-4b40-804c-38cc99df1b89 could not be found. Jan 11 03:59:14.779826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] Returning 404 to user: Instance 19f620db-2c73-4b40-804c-38cc99df1b89 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:59:14.780989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-29aae4b0-df9e-487a-ad19-32aac2ec40f7 tempest-VolumesActionsTest-815993076 tempest-VolumesActionsTest-815993076-project] 10.222.0.24 "GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89" status: 404 len: 111 microversion: 2.1 time: 0.049115 Jan 11 03:59:14.782690 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 175/337] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:14 2022] GET /compute/v2.1/servers/19f620db-2c73-4b40-804c-38cc99df1b89 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 03:59:14.798246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:14.799183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:14.806992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.813615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.814476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:14.814923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:14.948778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:14.963327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bea5d617-9745-41c4-bf8b-0c021fe4be9e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.269262 Jan 11 03:59:14.964658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 163/338] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:14 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:15.166600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cdd0fa23-1d7a-4952-9932-80c9ad272846 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.377481 Jan 11 03:59:15.167965 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 176/339] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:14 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:15.707666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:15.711638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:15.721897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-4dbcda1f-3e7f-4f3f-a05a-b0cbf1e23a40 req-c5b0e7c8-f649-43ab-b99b-68074bb8b8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52429ed3-0111-4a66-8657-ea8781028fac", "name": "network-vif-deleted", "tag": "06eae956-60c7-4107-9df5-42a3195364be"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:15.722709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:15.722709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:15.723804 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.724510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.725867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.726501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.736667 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4dbcda1f-3e7f-4f3f-a05a-b0cbf1e23a40 req-c5b0e7c8-f649-43ab-b99b-68074bb8b8dc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.737115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4dbcda1f-3e7f-4f3f-a05a-b0cbf1e23a40 req-c5b0e7c8-f649-43ab-b99b-68074bb8b8dc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.761563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-4dbcda1f-3e7f-4f3f-a05a-b0cbf1e23a40 req-c5b0e7c8-f649-43ab-b99b-68074bb8b8dc service nova] Creating event network-vif-deleted:06eae956-60c7-4107-9df5-42a3195364be for instance 52429ed3-0111-4a66-8657-ea8781028fac on hv-cinder-81977 Jan 11 03:59:15.770061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-4dbcda1f-3e7f-4f3f-a05a-b0cbf1e23a40 req-c5b0e7c8-f649-43ab-b99b-68074bb8b8dc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052606 Jan 11 03:59:15.771526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 177/340] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:15.777431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:15.779450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:15.791113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.792336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.793339 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.794364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.828838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.829304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.829925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lazy-loading 'fault' on Instance uuid 52429ed3-0111-4a66-8657-ea8781028fac {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 03:59:15.917872 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a74c976274f241d090c93adc88b75784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aff83f632b449699bbcc263750a7509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:15.944783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-65787264-35ab-4203-9f0e-28e657c60a62 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 200 len: 1305 microversion: 2.1 time: 0.246317 Jan 11 03:59:15.957784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 164/341] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:15 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 1305 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:15.981238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:15.982149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:15.988664 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.989347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:15.990548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:15.991214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:16.026358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:16.034501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7414604e-6916-46ae-afb6-290316912ee6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.261079 Jan 11 03:59:16.035254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 178/342] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:15 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:16.148932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:16.160289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c2e34717-0aff-478b-b919-a449f8096484 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.183404 Jan 11 03:59:16.161442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 165/343] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:15 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:16.178404 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:16.179734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:16.186657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:16.187345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:16.188322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:16.188759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:16.964869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:16.966279 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] [instance: 52429ed3-0111-4a66-8657-ea8781028fac] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:16.974657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:16.975103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:16.975898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:16.976352 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:16.994525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] HTTP exception thrown: Instance 52429ed3-0111-4a66-8657-ea8781028fac could not be found. Jan 11 03:59:16.995120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] Returning 404 to user: Instance 52429ed3-0111-4a66-8657-ea8781028fac could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:59:16.996129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6f9a2b71-12e6-4f55-8446-ac1192e5b880 tempest-VolumesNegativeTest-117444767 tempest-VolumesNegativeTest-117444767-project] 10.222.0.24 "GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac" status: 404 len: 111 microversion: 2.1 time: 0.036208 Jan 11 03:59:16.997454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 166/344] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:16 2022] GET /compute/v2.1/servers/52429ed3-0111-4a66-8657-ea8781028fac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 03:59:17.052097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:17.052705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:17.059184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:17.060094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:17.061114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:17.061886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:17.225628 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:17.235908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1cc4aa2a-5d40-45b8-bdf3-1c9d9e1af672 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.187705 Jan 11 03:59:17.236636 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 167/345] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:17 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:17.242416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:17.243092 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:17.250351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:17.250699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:17.251515 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:17.251953 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:17.411951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:17.420521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1d796719-c79f-4852-87a8-56fd1f74af53 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.182464 Jan 11 03:59:17.421469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 168/346] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:17 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:18.254671 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:18.255671 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:18.268422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:18.269641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:18.270956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:18.271592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:18.464338 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:18.472738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-18a150b2-45b2-458a-b011-55b9d35d5833 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.223401 Jan 11 03:59:18.481899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 169/347] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:18 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:18.481899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:18.482286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:18.489913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:18.490361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:18.491152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:18.491587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:18.758159 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:18.766718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a0bd3107-413e-450c-944c-d24559a554cc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.290365 Jan 11 03:59:18.769467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 170/348] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:18 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:19.489270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:19.489933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:19.500946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:19.500946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:19.500946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:19.500946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:19.641657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:19.649346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4daa21e2-1c9c-44fb-963d-5ced3f3419a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.163921 Jan 11 03:59:19.649933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 171/349] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:19 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:19.655439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'create', calling method: .version_select at 0x7f4e66462c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2058116597"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:19.675473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for project c185896a967e435eab256ec6827425a8. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:59:19.679510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for user 5d96ebc2f3514fbf98304b1b67091342 and project c185896a967e435eab256ec6827425a8. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:59:20.162060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-87b2c6df-a600-4ea4-a656-11cd6ab4fd8a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 3.987038 Jan 11 03:59:20.162870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 179/350] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:16 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 3989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:20.170017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:20.170716 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:20.178437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:20.178886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:20.179667 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:20.180102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:20.327371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:20.334794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b889a1c5-3571-498b-a9d0-b0a52f53f6de tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1317 microversion: 2.1 time: 0.170507 Jan 11 03:59:20.343831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 180/351] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:20 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:20.536513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for project c185896a967e435eab256ec6827425a8. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:59:20.540188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for user 5d96ebc2f3514fbf98304b1b67091342 and project c185896a967e435eab256ec6827425a8. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:59:20.553032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-77c4fa0d-5193-499d-85e2-6e7ae1dcb4d2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.902166 Jan 11 03:59:20.553640 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 172/352] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Jan 11 03:59:19 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:20.600266 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1574100445", "imageRef": "dfa4020f-48aa-4a44-a905-950da98eccc0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2058116597", "networks": [{"uuid": "5eff3635-4cd8-4ec5-b09b-60ab113b610c"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:20.651743 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] validate_networks() for [('5eff3635-4cd8-4ec5-b09b-60ab113b610c', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 03:59:20.666379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:20.667012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:20.673441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:20.673914 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:20.674849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:20.675287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:20.874552 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:20.881824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c7325e57-9fa9-4da1-a297-aaaac1430a8b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.219193 Jan 11 03:59:20.882390 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 173/353] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:20 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:21.076555 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 03:59:21.076980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 03:59:21.077455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 03:59:21.077920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 03:59:21.078337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 03:59:21.086976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.087424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.088239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.088674 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.105641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for project c185896a967e435eab256ec6827425a8. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 03:59:21.109574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Getting quotas for user 5d96ebc2f3514fbf98304b1b67091342 and project c185896a967e435eab256ec6827425a8. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 03:59:21.120321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 03:59:21.122626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfa4020f-48aa-4a44-a905-950da98eccc0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 03:59:21.172500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6a42ecf6-cb30-4079-8e67-832730ecd8b0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575737 Jan 11 03:59:21.178472 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 181/354] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 03:59:21.178677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:21.178677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:21.185486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e20643b9-2768-4fe4-84a2-1217caa4d089 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:21.185630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.186130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.186245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e20643b9-2768-4fe4-84a2-1217caa4d089 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:21.186980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.187464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.246094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e20643b9-2768-4fe4-84a2-1217caa4d089 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:21.256836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e20643b9-2768-4fe4-84a2-1217caa4d089 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1259 microversion: 2.1 time: 0.076829 Jan 11 03:59:21.257425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 182/355] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:21 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:21.285290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4a95f37f-7570-4149-8ca2-0f466a0e78d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.115420 Jan 11 03:59:21.286068 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 174/356] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:21 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:59:21.352279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:21.353294 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:21.361184 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.361643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.362620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.363069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.519896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:21.528912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4c9292c4-430e-47a3-8528-a6c09c5b5fe4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1507 microversion: 2.1 time: 0.180437 Jan 11 03:59:21.533728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 183/357] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:21 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:21.825296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-fc17345c-3f20-4068-925e-86752bdb2f4b req-18c6b0c7-d53c-4d70-8f41-8a6f0a837a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376b0310-ef7d-4609-ba47-c79f9805555b", "name": "network-vif-plugged", "status": "completed", "tag": "6aa178e1-0846-40fa-8f5f-6f757faea583"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:21.829540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:21.829540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:21.842239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-fc17345c-3f20-4068-925e-86752bdb2f4b req-18c6b0c7-d53c-4d70-8f41-8a6f0a837a55 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.843018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-fc17345c-3f20-4068-925e-86752bdb2f4b req-18c6b0c7-d53c-4d70-8f41-8a6f0a837a55 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.864631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-fc17345c-3f20-4068-925e-86752bdb2f4b req-18c6b0c7-d53c-4d70-8f41-8a6f0a837a55 service nova] Creating event network-vif-plugged:6aa178e1-0846-40fa-8f5f-6f757faea583 for instance 376b0310-ef7d-4609-ba47-c79f9805555b on hv-cinder-81977 Jan 11 03:59:21.873105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-fc17345c-3f20-4068-925e-86752bdb2f4b req-18c6b0c7-d53c-4d70-8f41-8a6f0a837a55 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052139 Jan 11 03:59:21.873987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 175/358] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:21.912249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:21.913152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:21.931609 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.933554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:21.936259 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:21.937565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:22.275402 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:22.276795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:22.285565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:22.298686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9bb8a6e9-5bcb-4e28-ba57-d87c0c2bc093 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.397407 Jan 11 03:59:22.299277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 184/359] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:21 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:22.308729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:22.309218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:22.310037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:22.310470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:22.310759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:22.313308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:22.320789 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:22.321533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:22.322881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:22.323547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:22.425814 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:22.433347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2733c92b-931d-4978-bb53-56daccddf77e tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1311 microversion: 2.1 time: 0.162950 Jan 11 03:59:22.434583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 176/360] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:22 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:23.176955 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6021a6a7-8b96-4390-ab23-a324093151b1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.875731 Jan 11 03:59:23.178231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 185/361] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:22 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:23.319635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:23.320402 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:23.335865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:23.338149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:23.343275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:23.346647 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:23.459951 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:23.460664 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:23.476740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:23.477498 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:23.478506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:23.479179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:23.588401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:23.597019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-43e06c8b-7243-4aea-9089-dde78cee6b40 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1329 microversion: 2.1 time: 0.141747 Jan 11 03:59:23.597967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 186/362] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:23 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1329 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:23.715709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:23.728914 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e114b77a-a140-4e77-b488-1f99c5d61e86 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.411439 Jan 11 03:59:23.730108 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 177/363] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:23 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:23.912144 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-14be90ca-fbad-4c6d-9af3-6d045cea7ce5 req-e4a67560-e2a5-407d-a6e2-a7f2a0440fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84501321-d633-43bb-9f6c-8802aefa5bd6", "name": "network-vif-plugged", "status": "completed", "tag": "2364fafc-197f-40d7-997d-ccc1075bbf00"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:23.913797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:23.913797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 03:59:23.933532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-14be90ca-fbad-4c6d-9af3-6d045cea7ce5 req-e4a67560-e2a5-407d-a6e2-a7f2a0440fe2 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:23.934878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-14be90ca-fbad-4c6d-9af3-6d045cea7ce5 req-e4a67560-e2a5-407d-a6e2-a7f2a0440fe2 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:23.958420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-14be90ca-fbad-4c6d-9af3-6d045cea7ce5 req-e4a67560-e2a5-407d-a6e2-a7f2a0440fe2 service nova] Creating event network-vif-plugged:2364fafc-197f-40d7-997d-ccc1075bbf00 for instance 84501321-d633-43bb-9f6c-8802aefa5bd6 on hv-cinder-81977 Jan 11 03:59:23.969459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-14be90ca-fbad-4c6d-9af3-6d045cea7ce5 req-e4a67560-e2a5-407d-a6e2-a7f2a0440fe2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061056 Jan 11 03:59:23.974888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 187/364] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:24.146588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39707897-2ce3-4b3a-b20e-fd85e8a0c010"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:24.148463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:24.157007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:24.158135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:24.159255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:24.160015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:24.189592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:24.191705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:24.204904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:24.205361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:24.210455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:24.213033 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:39.378843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8321bbcc-c5cb-41ab-a07a-51c9678f7e1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 15.193705 Jan 11 03:59:39.380863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 188/365] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:24 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 15197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:39.386269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:39.388995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:39.421270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:39.421775 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:39.422818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:39.423324 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:39.664050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d31ede99-5294-4505-bfe2-df5e6cca8be2 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.522008 Jan 11 03:59:39.665468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 178/366] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 03:59:24 2022] POST /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments => generated 194 bytes in 15525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:39.677906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:39.678678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:39.687734 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:39.688138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:39.690767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:39.691279 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:39.706506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:39.713953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6023625c-8375-4ebc-baf5-4339fb2ee854 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.331294 Jan 11 03:59:39.716256 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 189/367] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:39 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:39.956260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:39.969142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9e5c9dc4-1195-42ce-80f4-da200e79c0d0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.296269 Jan 11 03:59:39.969142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 179/368] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:39 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:40.391897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:40.393649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:40.400717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:40.401295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:40.402944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:40.403864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:40.437662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-aef2fa36-b930-4ec4-b3af-7ed98692e97c req-8f07f65a-c5d7-472f-8321-0406252bf3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:40.439440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:40.439440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:40.451847 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-aef2fa36-b930-4ec4-b3af-7ed98692e97c req-8f07f65a-c5d7-472f-8321-0406252bf3aa service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:40.455864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-aef2fa36-b930-4ec4-b3af-7ed98692e97c req-8f07f65a-c5d7-472f-8321-0406252bf3aa service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:40.478662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-aef2fa36-b930-4ec4-b3af-7ed98692e97c req-8f07f65a-c5d7-472f-8321-0406252bf3aa service nova] Creating event network-changed:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 03:59:40.488695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-aef2fa36-b930-4ec4-b3af-7ed98692e97c req-8f07f65a-c5d7-472f-8321-0406252bf3aa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054954 Jan 11 03:59:40.490111 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 180/369] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:59:40.733464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:40.734171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:40.740730 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:40.741234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:40.742093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:40.742541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:40.943981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:40.953443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a01c6037-d2b5-439e-80d7-ea2da1002060 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.224702 Jan 11 03:59:40.959479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fefd0100-225f-4853-a424-caeed8ca1289 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.571045 Jan 11 03:59:40.964545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 190/370] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:40 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:40.965926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 181/371] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:40 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:40.991291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:40.992336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:40.999499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.000278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:41.001308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.001924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:41.656274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:41.663463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3b560c8e-0c47-450c-be81-41c3e2231856 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.676282 Jan 11 03:59:41.664034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 191/372] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:40 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:41.971938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:41.973004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:41.979772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.980315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:41.981193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.981793 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:41.982177 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:41.982794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:41.989372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.989894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:41.990880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:41.991322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:42.156558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:42.163742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8a1c98fe-fdfd-44cf-877d-6b1cfe5a08aa tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.185313 Jan 11 03:59:42.164330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 192/373] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:41 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:42.680344 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:42.680963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:42.687601 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:42.688146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:42.689034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:42.689542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:42.820318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:42.827441 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2ec00b9f-f41f-4d01-9d50-a91a5d23f1bb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.150764 Jan 11 03:59:42.828018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 193/374] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:42 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:43.180340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:43.180942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:43.187750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:43.188195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:43.188969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:43.189401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:43.311560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:43.318706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-245be221-cb2c-4cc4-9b30-8dc82da36788 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.141994 Jan 11 03:59:43.319263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 194/375] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:43 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:43.844221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:43.844851 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:43.850676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:43.851125 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:43.851899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:43.852334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:43.983393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:43.990827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-91c0c18d-6a37-4d82-8005-a7507983ac51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.150781 Jan 11 03:59:43.991415 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 195/376] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:43 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:44.335018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:44.335631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:44.342062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:44.342512 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:44.343280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:44.343723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:44.471084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:44.478470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d144387e-9213-45b1-bc26-138c4521dae7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.147017 Jan 11 03:59:44.479032 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 196/377] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:44 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:45.007534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:45.008147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:45.014635 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:45.015086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:45.015862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:45.016299 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:45.139214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:45.146390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1973b37d-1ee4-44df-ac2d-34b8a532cc3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.142551 Jan 11 03:59:45.146946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 197/378] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:45 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:45.376686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f0906f56-4347-4866-8214-8e54e00d26f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 3.408643 Jan 11 03:59:45.377265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 182/379] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:41 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 3410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:45.494245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:45.494856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:45.501726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:45.502180 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:45.502958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:45.503395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:45.629969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:45.637545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0e9a3f93-5f5c-4191-86f0-bfbd9e029db0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.146976 Jan 11 03:59:45.638127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 198/380] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:45 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:46.163958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:46.164598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:46.171991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.172441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.173229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.173669 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.301514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:46.309459 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-86bd827d-4ccc-44a3-b2ae-eb8cc0ffb390 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.149499 Jan 11 03:59:46.310046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 183/381] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:46 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:46.387878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:46.388792 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:46.394659 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.395117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.395897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.396333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.654554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:46.655187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:46.661378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.661852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.662622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:46.663058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:46.790024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:46.797667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2892baf6-02c9-46b2-93d4-fbe3b2a01372 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.147527 Jan 11 03:59:46.798246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 184/382] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:46 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:47.326050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:47.326667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:47.332859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:47.333310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:47.334130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:47.334570 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:47.462235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:47.469365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b6d7d1d1-34dd-4687-b81e-399118f159d1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1322 microversion: 2.1 time: 0.147653 Jan 11 03:59:47.469957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 185/383] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:47 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:47.757073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-91be55eb-88e2-4515-95c8-01516e310ddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 1.372497 Jan 11 03:59:47.757603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 199/384] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:46 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:47.814435 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:47.815182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:47.821098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:47.821595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:47.822479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:47.822956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:47.955253 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:47.962455 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a6dbce9f-01b6-4701-ad29-e21c981d5d43 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.151904 Jan 11 03:59:47.963012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 186/385] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:47 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:48.487012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:48.487843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:48.496314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.496776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.497569 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.498070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.629580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:48.638050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a90992c2-68a2-473f-95d2-37943cc5890a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1516 microversion: 2.1 time: 0.155291 Jan 11 03:59:48.638795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 200/386] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:48 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:48.654321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:48.655336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:48.661137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.661622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.662421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.662856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.686607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'flavor' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 03:59:48.768477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:48.770039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:48.779420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.780150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.781162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.781616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.813881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2d3beafd-5bcb-4cff-9018-aa07495a0b83 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6/action" status: 200 len: 32 microversion: 2.1 time: 0.163516 Jan 11 03:59:48.814238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 187/387] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:48 2022] POST /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:59:48.823478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:48.824333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:48.831869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.832401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.833269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.833807 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.965122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7dc822d9-0c3d-463e-87c3-9a8100d01ad7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.199385 Jan 11 03:59:48.968732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 201/388] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:48 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:48.980529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:48.982677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:48.990147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.990736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:48.991695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:48.992228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:49.001010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:49.008655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f96fbf6f-f9ce-41ae-a13b-23827502d2db tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.189127 Jan 11 03:59:49.009446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 188/389] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:48 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:49.275968 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:49.285350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-88fdf499-c35e-4229-bcde-fcce7272710b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.309354 Jan 11 03:59:49.286188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 202/390] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:48 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:49.979493 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:49.980905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:49.987155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:49.987641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:49.988423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:49.988859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:50.027639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:50.028871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:50.036911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:50.037407 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:50.038261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:50.038708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:50.107199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c17c5782-8ecc-4a0d-b210-b3d1df8c21d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.131095 Jan 11 03:59:50.111715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 189/391] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:49 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:50.172756 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:50.181436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1dde50d4-e9d9-424e-bdfa-15445b694d7c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.157946 Jan 11 03:59:50.182127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 203/392] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:50 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:50.302187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:50.302906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:50.309830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:50.310276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:50.311052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:50.311483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:50.442628 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:50.452052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-19171358-c6b5-447a-81b7-0f00be0256f5 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.153763 Jan 11 03:59:50.452613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 190/393] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:50 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:51.118705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:51.119644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:51.126401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.126850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.127619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.128049 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.199708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:51.200238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:51.206638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.207257 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.208384 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.209027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.237536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d4fb9c0a-387c-4b2c-a2f7-ad2012438a42 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.122283 Jan 11 03:59:51.238494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 204/394] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:51 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:51.351570 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:51.359546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-89f2190b-34be-45db-a302-60c2c01735d3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.164308 Jan 11 03:59:51.360098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 191/395] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:51 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:51.470055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:51.470781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:51.477626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.478106 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.478885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:51.479317 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:51.616315 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:51.624992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bc7f6302-8704-40e3-b40c-2e528048c184 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.158913 Jan 11 03:59:51.625696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 205/396] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:51 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:52.249434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:52.250394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:52.256700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.257184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.258031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.258474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.376193 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:52.376975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:52.383155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.383598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.384367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.384796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.434703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bf47301e-0c9b-4530-826e-3824dc0f0600 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.189308 Jan 11 03:59:52.435709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 192/397] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:52 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:52.516276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:52.523751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-859e53a1-3850-43f6-8b3c-cbb0d6cfaf08 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.151122 Jan 11 03:59:52.524803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 206/398] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:52 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:52.644762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:52.645470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:52.652777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.653230 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.654290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:52.654728 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:52.788447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:52.797086 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8dbc877c-b903-429e-a388-fca58bbcf775 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.156319 Jan 11 03:59:52.797838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 193/399] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:52 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:53.446547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:53.447471 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:53.454179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.454631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.455420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.455857 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.541484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:53.542134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:53.552093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.552544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.553335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.553804 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.686970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:53.694933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5ab1436e-9210-4a7b-aeb5-61c65411aedd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.157049 Jan 11 03:59:53.695556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 194/400] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:53 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:53.712211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-81f8bd8a-c743-4d26-bbe0-ad29c085c7ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.269407 Jan 11 03:59:53.712860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 207/401] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:53 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:53.813574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:53.814447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:53.823347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.824361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.825431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:53.825897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:53.964977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:53.972142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b56c4d37-42d8-4a34-815a-cd172782835c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.162555 Jan 11 03:59:53.972697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 195/402] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:53 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:54.712590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:54.713291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:54.720191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.720652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:54.721447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.721921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:54.724744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:54.725660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:54.732239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.732802 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:54.733702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.734246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:54.978127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ef5060fb-4234-4d44-8e04-eec19a0b3546 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.257309 Jan 11 03:59:54.978767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 196/403] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:54 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 03:59:54.988667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:54.989470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:54.997275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.997653 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:54.998502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:54.998940 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:55.225235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:55.233591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9253469d-a9b4-40ad-a333-8b5920b08623 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.525034 Jan 11 03:59:55.234500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 208/404] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:54 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:55.237513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:55.247702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-499850c2-1430-45b7-9032-63160e2fcb9f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.262864 Jan 11 03:59:55.248202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 197/405] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:54 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:56.000747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:56.003174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:56.011695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.012137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.012995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.013377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.127822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cc3627d3-4a2a-464d-a268-b2cf7fc74f03 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.138449 Jan 11 03:59:56.130653 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 209/406] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:55 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:56.144375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-1e602917-3e9a-41d7-955b-d79ab5085748 req-e6227f2b-b0cb-4452-be5d-d4c2e9dfc095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "name": "network-vif-plugged", "status": "completed", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:56.146180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 03:59:56.146180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 03:59:56.155416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-1e602917-3e9a-41d7-955b-d79ab5085748 req-e6227f2b-b0cb-4452-be5d-d4c2e9dfc095 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.155952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-1e602917-3e9a-41d7-955b-d79ab5085748 req-e6227f2b-b0cb-4452-be5d-d4c2e9dfc095 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.171155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-1e602917-3e9a-41d7-955b-d79ab5085748 req-e6227f2b-b0cb-4452-be5d-d4c2e9dfc095 service nova] Creating event network-vif-plugged:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 03:59:56.178023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-1e602917-3e9a-41d7-955b-d79ab5085748 req-e6227f2b-b0cb-4452-be5d-d4c2e9dfc095 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Jan 11 03:59:56.178635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 198/407] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 03:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 03:59:56.255205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:56.255991 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:56.273352 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:56.274855 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:56.297582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.304121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.304575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.306370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.307132 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.308770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.310023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.313180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.641399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:56.650123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eaddff64-ff93-4fd6-b41b-0461260ea4f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.401103 Jan 11 03:59:56.650767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:56.662891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 210/408] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:56 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:56.670091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8f6bcf30-dabc-4942-89aa-d631c7b4d423 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.408901 Jan 11 03:59:56.670867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 199/409] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:56 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 03:59:56.711449 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39707897-2ce3-4b3a-b20e-fd85e8a0c010"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:56.712549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:56.719244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.719696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.720489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.720925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.802387 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Invalid volume: volume 39707897-2ce3-4b3a-b20e-fd85e8a0c010 is already attached to instances: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a Jan 11 03:59:56.803095 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 400 to user: Invalid volume: volume 39707897-2ce3-4b3a-b20e-fd85e8a0c010 is already attached to instances: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 03:59:56.804004 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3fa4cda1-2616-4cfb-9f90-7bbcd643fa25 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096565 Jan 11 03:59:56.808000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 211/410] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 03:59:56 2022] POST /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 11 03:59:56.865492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:56.866121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:56.872127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.872658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.873562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:56.874122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:56.996660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lazy-loading 'services' on Instance uuid b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 03:59:57.124875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-05f8f61e-8905-41ef-bbba-315b495bc0cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments/39707897-2ce3-4b3a-b20e-fd85e8a0c010" status: 202 len: 0 microversion: 2.1 time: 0.262824 Jan 11 03:59:57.128859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 200/411] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 03:59:56 2022] DELETE /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments/39707897-2ce3-4b3a-b20e-fd85e8a0c010 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 03:59:57.135186 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:57.136900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:57.143506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.144367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.144583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:57.145991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:57.146365 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.146973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.155174 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.155820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.156660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.157284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.185825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0d0d44b1-becc-4fd7-8fb9-b31c01fe2e90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054748 Jan 11 03:59:57.187030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 212/412] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:59:57 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:57.468539 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-271a7eb7-d804-4d1e-bcf3-5ce1cfeccb52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.329586 Jan 11 03:59:57.472564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 201/413] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:57 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:57.676672 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:57.677966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:57.690099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:57.692476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:57.703475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.705346 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.709290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.712422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.728530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.730526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:57.731601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:57.732838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:58.038300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:58.059543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-38bd2832-a74b-44fe-a5cf-d803a6b0844a tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.375228 Jan 11 03:59:58.060619 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 202/414] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:57 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:58.070291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:58.083620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9886947c-eb96-4d6d-8604-d9f19b03b4c3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.417208 Jan 11 03:59:58.087410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 213/415] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:57 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:58.198055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:58.200663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:58.208709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:58.210624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:58.211959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:58.213140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:58.271473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bcc8e277-6a85-4604-9f6d-576e94e63c7b tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076245 Jan 11 03:59:58.272668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 203/416] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:59:58 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 03:59:58.483239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:58.498995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:58.516636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:58.517090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:58.518710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:58.519507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:58.677783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0f75654a-fdf7-4372-8d0e-baedb5f43b27 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.199815 Jan 11 03:59:58.679789 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 214/417] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:58 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:59.076835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:59.077444 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:59.120054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:59.121075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:59.132504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.133056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.142522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.143189 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.158086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.162722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.176296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.177784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.506138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:59.515854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4c09c82d-8247-4df0-a1d6-586ccf50e4b1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.409070 Jan 11 03:59:59.519073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 03:59:59.525085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 215/418] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:59 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:59.528249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1041b9d0-746e-46b2-90d7-6faebc5dd366 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1359 microversion: 2.1 time: 0.455611 Jan 11 03:59:59.530598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 03:59:59.531683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:59.534981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 204/419] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 03:59:59 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1359 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 03:59:59.538318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.539067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.540047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.540638 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.582045 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-99474b61-b6f2-4bb6-b4a5-4c4ef80c43ff tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055497 Jan 11 03:59:59.586933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 216/420] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 03:59:59 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 03:59:59.689654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:59.690971 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 03:59:59.699171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.699737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.700699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 03:59:59.701274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 03:59:59.773657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1716789545", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "7c3b392c-7bdf-40a2-b1a9-2f3039d2829a"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 03:59:59.826774 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0c43f8fc-9579-4173-8efe-fa305d155d25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.141157 Jan 11 03:59:59.827591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 205/421] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 03:59:59 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 03:59:59.831664 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] validate_networks() for [('7c3b392c-7bdf-40a2-b1a9-2f3039d2829a', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:00:00.277358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:00:00.277837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:00:00.278573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:00:00.279048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:00:00.279398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:00:00.288477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.288925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.289793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.290234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.308446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:00:00.313371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Getting quotas for user 4dcd5f80a739403ab7577cc398ba0754 and project b0c5a36c198849fb8c8fce04cd34151b. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:00:00.324671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:00:00.327033 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:00:00.374740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-375ecb7b-bf32-4b82-8c91-1613042a35a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604578 Jan 11 04:00:00.380577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 217/422] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 03:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 11 04:00:00.387697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bada466f-be9a-4c7d-ba7c-778b7650899c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:00.390933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bada466f-be9a-4c7d-ba7c-778b7650899c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:00.487567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bada466f-be9a-4c7d-ba7c-778b7650899c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:00.498143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bada466f-be9a-4c7d-ba7c-778b7650899c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1218 microversion: 2.1 time: 0.115407 Jan 11 04:00:00.509029 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 206/423] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:00 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:00.532484 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:00.533090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:00.543957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.544683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.545857 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.546479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.550397 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:00.551182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:00.565248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.565823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.568011 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.568947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.912569 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:00.927360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ec40ecad-20ac-4cdc-bcfd-f1b5540cd769 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.398851 Jan 11 04:00:00.927945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 218/424] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:00 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:00.932513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:00.941379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dd413fb9-d90a-4ae3-992c-afb0dcde2ce2 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1550 microversion: 2.1 time: 0.397843 Jan 11 04:00:00.955806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 207/425] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:00 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1550 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:00.956031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:00.957134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:00.965351 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.965833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.966055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:00.966677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:00.967464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.968056 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.975145 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.976262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:00.977875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:00.978475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.110345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0dc5d7be-685e-4282-8828-835ceb15df25 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.181077 Jan 11 04:00:01.111099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 219/426] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:00 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:01.213384 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:01.230301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-95acab40-943e-4b5a-ba93-c91ec1db897f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1550 microversion: 2.1 time: 0.269250 Jan 11 04:00:01.242404 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 208/427] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:00 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1550 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:01.250677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:01.254407 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:01.254407 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:01.256079 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:01.257296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Searching by: {'deleted': False, 'project_id': 'c185896a967e435eab256ec6827425a8'} {{(pid=116388) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 11 04:00:01.266020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.266847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.268484 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.269611 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.378024 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.multi_cell_list [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116388) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 11 04:00:01.488332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d6057881-036e-4a54-87b8-73e31b51eef0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241692 Jan 11 04:00:01.488919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 220/428] 10.222.0.24 () {58 vars in 1124 bytes} [Tue Jan 11 04:00:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:01.500185 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:01.500788 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:01.506692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.508616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.509024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.509455 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.518515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:01.519656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:01.529804 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.530762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.533287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:01.534780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:01.639191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:01.647542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2e4b5098-115e-44cd-ba93-57967fefe188 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1270 microversion: 2.1 time: 0.136114 Jan 11 04:00:01.648655 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 221/429] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:01 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:01.695375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:01.709983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ae259092-ce7c-433b-a3ba-2057bc1d8226 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1550 microversion: 2.1 time: 0.213309 Jan 11 04:00:01.724002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 209/430] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:01 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1550 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:01.949732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:01.952152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:02.000016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.001605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.005641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.009119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.123409 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:02.124950 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:02.137098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.137550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.142077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.144331 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.344485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dbadceb3-75fb-4258-981a-eedd55a66357 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.225005 Jan 11 04:00:02.350215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 210/431] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:02 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:02.426282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:02.436382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8d09c3dc-dc43-4eef-a6b1-dc8dea18c9f4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.493303 Jan 11 04:00:02.438392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 222/432] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:01 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:02.669419 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:02.671201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:02.686372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.687608 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.688452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:02.688898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:02.789961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:02.806274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7aa518fe-d6cd-4ab3-8ba5-ef49c7e83b13 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1276 microversion: 2.1 time: 0.141387 Jan 11 04:00:02.807558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 211/433] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:02 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:03.356913 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:03.357861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:03.365995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.366697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:03.367662 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.368110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:03.455210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:03.456746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:03.467322 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.468476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:03.470099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.472611 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:03.511967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f26f56bb-60be-4ebc-86cd-68ddd640315f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.158180 Jan 11 04:00:03.513354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 223/434] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:03 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:03.771001 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:03.786479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2282db4b-a1f1-4a7c-891c-90a7c8ce05aa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.337409 Jan 11 04:00:03.787479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 212/435] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:03 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:03.825037 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:03.826179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:03.844160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.844854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:03.850028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:03.850985 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.332148 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:04.339850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b33491af-cb6c-4ba5-969f-09b34096d4a1 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.519350 Jan 11 04:00:04.342845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 224/436] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:03 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:04.527114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:04.528237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:04.539656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.541625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.542604 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.543051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.731840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-7bde25ae-8220-4ac2-8e5f-be9c42be2071 req-712549bb-0ec6-4103-a87d-2e29fed6b175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049756f8-45e1-48c5-9503-67b2a9e2ced4", "tag": "b1fe0740-97fc-43bd-a247-f5c19d3fd577"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:04.733465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:04.733465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:04.743208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-7bde25ae-8220-4ac2-8e5f-be9c42be2071 req-712549bb-0ec6-4103-a87d-2e29fed6b175 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.746682 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-7bde25ae-8220-4ac2-8e5f-be9c42be2071 req-712549bb-0ec6-4103-a87d-2e29fed6b175 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.769698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-7bde25ae-8220-4ac2-8e5f-be9c42be2071 req-712549bb-0ec6-4103-a87d-2e29fed6b175 service nova] Creating event network-changed:b1fe0740-97fc-43bd-a247-f5c19d3fd577 for instance 049756f8-45e1-48c5-9503-67b2a9e2ced4 on hv-cinder-81977 Jan 11 04:00:04.783969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-7bde25ae-8220-4ac2-8e5f-be9c42be2071 req-712549bb-0ec6-4103-a87d-2e29fed6b175 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057980 Jan 11 04:00:04.789084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 225/437] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jan 11 04:00:04.800744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8797f157-96c4-48f7-8249-c90ed505a7a6"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:04.802204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:04.812329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.812796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.813603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.814091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.953328 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9486663d-65e6-47e2-aad8-0275f6b46bec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.431083 Jan 11 04:00:04.954824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 213/438] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:04 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:04.960756 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:04.969110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:04.991223 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.992825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:04.994457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:04.995166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:05.318332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8b814f17-df95-45b5-884e-f217b3894e80 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525780 Jan 11 04:00:05.325729 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 226/439] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:00:04 2022] POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:05.359251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:05.359983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:05.372957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:05.372957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:05.383700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:05.386201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:05.970801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:05.980491 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a8adebf6-b3ae-46b6-81ff-71d7ac0ed6cb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.625526 Jan 11 04:00:05.982481 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 227/440] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:05 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:05.992479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:05.999548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:06.024793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:06.026053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:06.027580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:06.028689 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:06.058969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:06.078957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4e71250d-7bc6-4fec-bc61-1aec6f4565b7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 1.122564 Jan 11 04:00:06.089485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 214/441] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:04 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:06.134719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7efad3ff-caed-4ca0-b05a-da486d1808a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.150808 Jan 11 04:00:06.136053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 228/442] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:05 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:06.999470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:07.000188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:07.008145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.008594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.009386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.009864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.151246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:07.159157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3abdb36e-8dcc-45a3-83fb-19d651d988d5 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.164094 Jan 11 04:00:07.159732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 229/443] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:06 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:07.164313 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:07.164914 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:07.171875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.172399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.173413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.174053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.193646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Action: 'create', calling method: .version_select at 0x7f4e65a06d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-228509899"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:07.209291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:00:07.213202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for user 9a2cd37f07db460081345374727b0e4d and project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:00:07.312361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:07.321631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c7b2a176-9d55-450d-9ffe-860a1e9455cf tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.160636 Jan 11 04:00:07.331101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 230/444] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:07 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:07.331101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:07.331101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:07.336806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.337438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.338561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:07.338840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:07.522278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-295133b6-1aff-44a4-a7f8-c145483c7e33 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.198417 Jan 11 04:00:07.544117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 231/445] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:07 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:07.548933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:00:07.552711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for user 9a2cd37f07db460081345374727b0e4d and project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:00:07.566335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c343fa6e-0d59-4167-a6fd-47ff14d1f916 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.583208 Jan 11 04:00:07.566938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 215/446] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Jan 11 04:00:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:08.179582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:08.180341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:08.187555 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.188006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.188802 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.189232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.338393 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:08.339518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:08.345343 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.346237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.347256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.347907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.371701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:08.380837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5b217834-cd58-4bcf-bc96-744b7e89d02d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.206902 Jan 11 04:00:08.381485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 232/447] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:08 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:08.534375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:08.548371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:08.550450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:08.559319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c13e8622-d6a4-4f7e-9bb9-184dc0ea2012 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.224795 Jan 11 04:00:08.564585 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 216/448] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:08 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:08.580499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.581085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.582196 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:08.584536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:08.735023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6d7c40f2-6632-4de5-b9e7-c28aa522c020 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.190634 Jan 11 04:00:08.735888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 233/449] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:08 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:09.402366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:09.402984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:09.409236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.409744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.410542 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.410987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.552180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:09.560231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3d27445d-3113-4962-bb7e-33b31b7695ae tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.161876 Jan 11 04:00:09.560822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 217/450] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:09 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:09.581203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:09.582706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:09.592483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.593274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.594265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.594644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.740843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:09.750869 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3f83bcf6-5943-4313-bf74-116e602fcc22 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.173581 Jan 11 04:00:09.752121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 234/451] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:09 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:09.754666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:09.756281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:09.765609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.766218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.767013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:09.767439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:09.939890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8ab9921b-44fc-4a0e-8eae-5f2b7a9087a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.196117 Jan 11 04:00:09.945855 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 218/452] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:09 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:10.578251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:10.578819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:10.585750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.586438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:10.587007 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.587451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:10.733475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:10.740879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a035f3d6-cf2c-420f-bff7-38715a7b25db tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.166559 Jan 11 04:00:10.742038 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 235/453] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:10 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:10.769604 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:10.770758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:10.779728 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.780182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:10.780974 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.781412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:10.912590 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:10.921088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6300a76f-7738-4c6b-be27-a47af2ff6168 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.155668 Jan 11 04:00:10.921652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 219/454] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:10 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:10.951830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:10.952954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:10.959754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.960283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:10.961168 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:10.961838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:11.071270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bb15b305-dc84-4ca2-a3ea-d731e02606a9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.123364 Jan 11 04:00:11.075327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 236/455] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:10 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:11.758599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:11.759241 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:11.766246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:11.766691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:11.767474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:11.767907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:11.904481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:11.911824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8a973249-0a42-4a25-b604-b68b806f1a65 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.157208 Jan 11 04:00:11.912379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 220/456] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:11 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:11.938074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:11.938783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:11.945938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:11.946397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:11.947189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:11.947628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:12.082927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:12.083861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:12.084867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:12.090614 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:12.091064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:12.091834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:12.092264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:12.093564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-390b0e15-007d-4544-a42f-b23df014f1ae tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.159687 Jan 11 04:00:12.097267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 237/457] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:11 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:12.233038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c5e3c3c0-3202-40f7-a639-0b841fb9307c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.152601 Jan 11 04:00:12.233038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 221/458] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:12 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:12.928406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:12.929053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:12.935693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:12.936338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:12.937242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:12.937920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:13.066542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:13.074419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5c0e46ab-60dc-4a68-ab19-4644149e391a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.149795 Jan 11 04:00:13.074983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 238/459] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:12 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:13.110683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:13.111371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:13.128678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:13.129124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:13.129948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:13.130418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:13.244641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:13.245630 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:13.252318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:13.252778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:13.253573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:13.254040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:13.268478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:13.275754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0d5275be-1383-40ff-a0c4-9743d6870aa2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.169030 Jan 11 04:00:13.276874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 222/460] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:13 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:13.428769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-936a3efd-6a4c-47c6-92de-6048e80940bc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 28636 microversion: 2.1 time: 0.187920 Jan 11 04:00:13.429667 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 239/461] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:13 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 28636 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:13.995500 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:13.996164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:14.002082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.002527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.003298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.003727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.091365 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:14.092712 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:14.100086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.100625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.101621 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.102087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.143509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:14.155301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0b162e51-9f9b-4969-a49a-04a510cf4e42 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1596 microversion: 2.1 time: 0.163301 Jan 11 04:00:14.166229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 223/462] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:13 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1596 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:14.173135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-d2bb21a3-2dfc-42c0-ac6b-88943d348b0f req-cee13cdc-9ae4-43a9-bf2d-ea87db5d95b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049756f8-45e1-48c5-9503-67b2a9e2ced4", "name": "network-vif-plugged", "status": "completed", "tag": "b1fe0740-97fc-43bd-a247-f5c19d3fd577"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:14.175426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:14.175426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:00:14.184226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-d2bb21a3-2dfc-42c0-ac6b-88943d348b0f req-cee13cdc-9ae4-43a9-bf2d-ea87db5d95b5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.184796 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-d2bb21a3-2dfc-42c0-ac6b-88943d348b0f req-cee13cdc-9ae4-43a9-bf2d-ea87db5d95b5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.197486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-d2bb21a3-2dfc-42c0-ac6b-88943d348b0f req-cee13cdc-9ae4-43a9-bf2d-ea87db5d95b5 service nova] Creating event network-vif-plugged:b1fe0740-97fc-43bd-a247-f5c19d3fd577 for instance 049756f8-45e1-48c5-9503-67b2a9e2ced4 on hv-cinder-81977 Jan 11 04:00:14.202760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-d2bb21a3-2dfc-42c0-ac6b-88943d348b0f req-cee13cdc-9ae4-43a9-bf2d-ea87db5d95b5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034930 Jan 11 04:00:14.203476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 224/463] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:14.264286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:14.271896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b4ed49d1-8829-443b-90dd-010ea24014d8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.185020 Jan 11 04:00:14.272867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 240/464] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:14 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:14.295355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:14.296393 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:14.302548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.303261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.304152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.304559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.440344 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:14.441601 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:14.449477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.450062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.451759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:14.452430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:14.502918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:14.512260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f24807f6-7f35-47d6-970a-a9529b908d5c tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.221835 Jan 11 04:00:14.512834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 225/465] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:14 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:14.595909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-72b24f4a-1754-4067-b6d4-d539f04f584d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 29845 microversion: 2.1 time: 0.159228 Jan 11 04:00:14.599881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 241/466] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:14 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 29845 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:15.289210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:15.289982 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:15.296734 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.297250 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.298178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.298608 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.438368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:15.450019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-460865e0-1edf-4bac-ae79-13725bd5c078 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.164391 Jan 11 04:00:15.451957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 226/467] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:15 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:15.530806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:15.531564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:15.538382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.538855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.539797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.540259 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.609046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:15.610264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:15.616731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.617231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.618214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:15.618646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:15.675913 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:15.683964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-daf89fe1-366f-4abc-9eac-dcb73e35fe06 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.157365 Jan 11 04:00:15.684525 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 242/468] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:15 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:15.753539 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4e6cac20-f4c2-441b-902f-ac81e5c2696c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 30801 microversion: 2.1 time: 0.148730 Jan 11 04:00:15.754514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 227/469] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:15 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 30801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:16.289430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-c3826fe8-323e-494d-b85b-8aa1ed7efc98 req-6a9f9ee6-d9dd-4811-af8b-3cba1233e9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:16.291103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:16.291103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:16.300413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-c3826fe8-323e-494d-b85b-8aa1ed7efc98 req-6a9f9ee6-d9dd-4811-af8b-3cba1233e9ce service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.300982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-c3826fe8-323e-494d-b85b-8aa1ed7efc98 req-6a9f9ee6-d9dd-4811-af8b-3cba1233e9ce service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.314020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-c3826fe8-323e-494d-b85b-8aa1ed7efc98 req-6a9f9ee6-d9dd-4811-af8b-3cba1233e9ce service nova] Creating event network-changed:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 04:00:16.320069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-c3826fe8-323e-494d-b85b-8aa1ed7efc98 req-6a9f9ee6-d9dd-4811-af8b-3cba1233e9ce service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034709 Jan 11 04:00:16.320884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 243/470] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:16.472562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:16.473417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:16.481955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.482679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.485079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.485710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.701791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:16.703196 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:16.709425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.710602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.711721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.712386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.837502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:16.855760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e5c5b06b-f5bc-41c7-a766-52a4632008c8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1318 microversion: 2.1 time: 0.388074 Jan 11 04:00:16.856376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 228/471] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:16 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:16.873571 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:16.874532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:16.882451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.882904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.883694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:16.884348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:16.984754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:16.995139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-20f41c8e-84cf-4165-a63b-44fbb6dc0db7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.297731 Jan 11 04:00:16.996124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 244/472] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:16 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:17.051093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f625850d-9bee-47ff-9027-ea1627103c53 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 32025 microversion: 2.1 time: 0.190340 Jan 11 04:00:17.056315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 229/473] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:16 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 32025 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:17.589047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1214849636"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:17.589807 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:17.598718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:17.599224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:17.600028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:17.600477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:17.731772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.network.security_group_api [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Adding security group cc58dce6-d76b-46a4-a365-b0c225fc104b to port 8ca3ad13-c0eb-4d6c-8401-30168e256551 Jan 11 04:00:17.873292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:17.874041 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:17.880853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:17.881309 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:17.882126 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:17.882565 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.104839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:18.114480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cf309c49-7fc3-4bd5-b77e-6cdeef516376 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1508 microversion: 2.1 time: 0.245614 Jan 11 04:00:18.115202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 230/474] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:17 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:18.119710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:18.120339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:18.126413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.126913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.128109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.128547 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.158017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-808ee88d-aee4-45d5-bd24-f38273e12b0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action" status: 202 len: 0 microversion: 2.1 time: 0.574224 Jan 11 04:00:18.162075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 245/475] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:17 2022] POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:00:18.165249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:18.169723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:18.182708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.184973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.185960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.186771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.311485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:18.320910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0317d8b6-9397-4c27-b3e0-d3f889ab6de6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.204481 Jan 11 04:00:18.323792 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 231/476] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:18 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:18.331777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:18.334112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:18.340881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-707554c1-811d-4de1-92b8-6dba205db186 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 32825 microversion: 2.1 time: 0.179806 Jan 11 04:00:18.345163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 246/477] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:18 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 32825 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:18.348505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.348960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.349895 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.350504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.350740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-77571a0f-0727-4f4e-896a-90bffc2a8152 req-13bf6f8b-79d4-4eb2-b4a1-9c9fa91425d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:18.352265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:18.352265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:18.360046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-77571a0f-0727-4f4e-896a-90bffc2a8152 req-13bf6f8b-79d4-4eb2-b4a1-9c9fa91425d5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:18.360494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-77571a0f-0727-4f4e-896a-90bffc2a8152 req-13bf6f8b-79d4-4eb2-b4a1-9c9fa91425d5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:18.372249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-77571a0f-0727-4f4e-896a-90bffc2a8152 req-13bf6f8b-79d4-4eb2-b4a1-9c9fa91425d5 service nova] Creating event network-changed:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 04:00:18.379866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-77571a0f-0727-4f4e-896a-90bffc2a8152 req-13bf6f8b-79d4-4eb2-b4a1-9c9fa91425d5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032584 Jan 11 04:00:18.380502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 247/478] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:18.602246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:18.610972 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7cf2d220-4a4d-4752-b0a9-00d472534c70 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1762 microversion: 2.1 time: 0.282572 Jan 11 04:00:18.611549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 232/479] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:18 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1762 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:19.340559 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:19.341195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:19.347233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:19.347684 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:19.348637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:19.349115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:19.356232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:19.357769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:19.365004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:19.365444 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:19.366452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:19.366908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:19.486315 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:19.493875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-24b771f0-8a00-4160-abb1-8e9ed4562e25 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.157768 Jan 11 04:00:19.494482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 248/480] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:19 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:19.548224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0d1c18c3-f56f-4149-84dc-5aa8bbb996f3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 33361 microversion: 2.1 time: 0.198604 Jan 11 04:00:19.548915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 233/481] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:19 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 33361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:20.510205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:20.511391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:20.517748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.518203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.518983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.519421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.561033 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:20.562100 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:20.569121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.569569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.570385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.570826 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.649283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:20.656889 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-96876ccf-2d07-4cf4-ac37-56be73c62ea3 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.150399 Jan 11 04:00:20.657454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 249/482] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:20 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:20.661770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "817eeda4-3be1-4b65-97e6-6fbf1f724f70"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:20.662802 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:20.668713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.669233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.670116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:20.670554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:20.700002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b1ecf019-ba07-4749-a580-8731318f8f92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 33771 microversion: 2.1 time: 0.143297 Jan 11 04:00:20.700773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 234/483] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:20 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 33771 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:00:20.942901 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fc9d14ae-c500-43dd-8c74-b40cdd68f0a8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "POST /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284209 Jan 11 04:00:20.943505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 250/484] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:00:20 2022] POST /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:21.674046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:21.674831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:21.681595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:21.682081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:21.682867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:21.683314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:21.712956 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:21.714030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:21.720291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:21.720748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:21.721535 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:21.722002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:21.823427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:21.832207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-91ce7029-b02b-49bf-a575-bf3a01b46a28 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.162353 Jan 11 04:00:21.832411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f1e5dc42-66a5-4f58-8316-b8cb7af3b3e7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 34505 microversion: 2.1 time: 0.123619 Jan 11 04:00:21.833335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 251/485] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:21 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 34505 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:21.834801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 235/486] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:21 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:22.847964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:22.849943 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:22.851733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:22.852344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:22.859083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:22.859535 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:22.860326 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:22.860471 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:22.860923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:22.861040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:22.863191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:22.863191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:22.994554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:23.002080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-036f3a05-4df1-492e-8fa8-ea81f9e25b44 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.153907 Jan 11 04:00:23.003458 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 236/487] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:22 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:23.471545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f53738b5-9051-4198-a8bc-722577f6b03e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 35756 microversion: 2.1 time: 0.629500 Jan 11 04:00:23.472103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 252/488] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:22 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 35756 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:24.020596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:24.021224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:24.028127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:24.028829 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:24.029608 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:24.030067 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:24.159423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:24.166969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-37a1ca0d-9cd3-408f-bdf0-dde30685aef5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.150405 Jan 11 04:00:24.168671 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 237/489] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:24 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:24.483487 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:24.484397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:24.492211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:24.492664 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:24.493454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:24.493931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:25.184460 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:25.185066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:25.191486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:25.191930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:25.192711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:25.193142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:25.325610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:25.332809 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ddc95757-3021-4077-bb5a-4f5997732667 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.152588 Jan 11 04:00:25.333367 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 238/490] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:25 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:26.348754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:26.349341 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:26.355948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:26.356392 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:26.357163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:26.357692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:26.487567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:26.495507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ab09eb08-f200-4eeb-9e87-85b14d0cf6a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.150720 Jan 11 04:00:26.496686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 239/491] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:26 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:27.513822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:27.514441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:27.520889 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:27.521344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:27.522146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:27.522585 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:27.651900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:27.659442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-37a628a8-d5d8-49e7-b6bd-8b69c81fda36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.149880 Jan 11 04:00:27.660008 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 240/492] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:27 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:28.675815 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:28.676454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:28.682574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:28.683023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:28.683833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:28.684261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:28.809310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:28.816408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-06779cd0-3c7a-4b0c-b911-1d476479a618 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.144257 Jan 11 04:00:28.816966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 241/493] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:28 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:29.833296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:29.833946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:29.840164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:29.840610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:29.841389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:29.842114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:29.967396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:29.974598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6705f09d-1d25-482c-93ed-6ff58e52fbfb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.144922 Jan 11 04:00:29.975163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 242/494] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:29 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:30.196418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f17f0c9b-57ef-4f38-a2a7-38b5cd8053ec tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 38069 microversion: 2.1 time: 5.716851 Jan 11 04:00:30.197284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 253/495] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:24 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 38069 bytes in 5719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:30.991794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:30.992395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:30.998677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:30.999119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:30.999887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:31.000317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:31.128746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:31.135875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cd1f4cc4-5332-4d7d-b3d0-61f16895fe0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.148033 Jan 11 04:00:31.136981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 243/496] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:30 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:31.207691 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:31.208730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:31.215741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:31.216188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:31.216966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:31.217400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:31.527406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8031c4cd-ea06-4669-8835-c63b2495407b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 38069 microversion: 2.1 time: 0.322954 Jan 11 04:00:31.528147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 254/497] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:31 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 38069 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:32.152567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:32.154199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:32.160193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.160638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.161423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.161970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.295653 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:32.303180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-35e841bf-0c7b-41d2-894f-0d31feb5d387 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.154346 Jan 11 04:00:32.303785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 244/498] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:32 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:32.546390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:32.547473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:32.557235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.557713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.558511 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.558950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.689335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:32.689888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:32.695647 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.696093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.696866 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.697301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.764026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3e05893d-6196-4a22-9af2-f3078754643b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 200 len: 38198 microversion: 2.1 time: 0.227936 Jan 11 04:00:32.766064 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 255/499] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:32 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 38198 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:00:32.775087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lazy-loading 'services' on Instance uuid 049756f8-45e1-48c5-9503-67b2a9e2ced4 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:00:32.775268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:32.775708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:32.783432 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.783878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.784665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.785101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.811136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fa97452a-7f81-49da-bf6b-4dc9cf4b67d6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/ips" status: 200 len: 144 microversion: 2.1 time: 0.039707 Jan 11 04:00:32.811714 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 256/500] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 04:00:32 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:00:32.843929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-967c0838-6e2b-46cd-8619-97633a7b2710 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments/817eeda4-3be1-4b65-97e6-6fbf1f724f70" status: 202 len: 0 microversion: 2.1 time: 0.158288 Jan 11 04:00:32.844514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 245/501] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:00:32 2022] DELETE /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments/817eeda4-3be1-4b65-97e6-6fbf1f724f70 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:00:32.852504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:32.853476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:32.860362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.860971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.861912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:32.862624 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:32.893379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7564c725-a104-4a6a-958e-f7760f489e24 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Jan 11 04:00:32.893984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 257/502] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:32 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:33.321438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:33.322173 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:33.328825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:33.329279 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:33.330128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:33.330569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:33.770798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:33.778169 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2df16b25-808c-48b3-9884-429c0cff29da tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.461241 Jan 11 04:00:33.779195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 246/503] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:33 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:33.905170 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:33.906116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:33.913218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:33.913882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:33.914841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:33.915515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:33.949977 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4907c630-2593-4852-bf45-d2372b66063a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049292 Jan 11 04:00:33.950742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 258/504] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:33 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:34.794871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:34.795561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:34.802145 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:34.802677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:34.803682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:34.804198 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:34.946903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:34.954494 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ba966a33-19a8-402b-ae87-75e09e021333 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.163554 Jan 11 04:00:34.955058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 247/505] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:34 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:34.961061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:34.962018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:34.968218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:34.968673 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:34.969451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:34.969997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:35.000681 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-54522c19-5d85-4fef-a12b-ba746a08169a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Jan 11 04:00:35.001236 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 259/506] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:34 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:00:35.971258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:35.971879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:35.978107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:35.978554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:35.979328 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:35.979761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:36.012919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:36.013995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:36.020326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:36.020785 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:36.021578 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:36.022061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:36.051419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9171c70d-37b3-4a7f-9768-3302993f0c0a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042998 Jan 11 04:00:36.051990 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 260/507] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:36 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:36.105892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:36.113105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8d1c2d23-0c81-4aca-9576-930deac55c51 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.145416 Jan 11 04:00:36.113605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 248/508] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:35 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:37.063175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:37.064076 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:37.070694 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:37.071141 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:37.071911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:37.072340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:37.099761 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-275b5c55-d3d6-4cc7-b8a9-de780ec6b009 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040411 Jan 11 04:00:37.100298 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 261/509] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:37 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:37.129549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:37.130122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:37.136414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:37.136875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:37.137663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:37.138126 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:37.266095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:37.273300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8a174307-7839-4329-97d9-436e0bd52bef tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1522 microversion: 2.1 time: 0.147405 Jan 11 04:00:37.274007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 249/510] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:37 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:38.111803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:38.112929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:38.120046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.121156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.122041 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.122483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.151416 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a3c9fc9c-9f8d-4406-9c1c-2f7db446e8f4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044218 Jan 11 04:00:38.151971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 262/511] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:00:38 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:00:38.289911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:38.290733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:38.297112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.297570 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.298396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.298832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.429171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:38.436881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2a95508a-15a3-456f-bb76-d4dd22d25d8e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1502 microversion: 2.1 time: 0.150583 Jan 11 04:00:38.437449 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 250/512] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:38 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:38.452647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:38.453270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:38.459082 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.459536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.460325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:38.460765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:38.591113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:38.598580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2ed17c60-5bd6-48cd-83af-af59d55524ee tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1514 microversion: 2.1 time: 0.150052 Jan 11 04:00:38.599143 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 263/513] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:38 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:39.085835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "583d2988-9335-4793-914e-8fba2e0f4fbd"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:39.086999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:39.093324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:39.093807 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:39.094587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:39.095195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:39.382949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cfb8a2f4-1c35-41bf-ab9d-7044d77c4e72 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300733 Jan 11 04:00:39.385733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 251/514] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:00:39 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:40.414660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:40.415149 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:40.421281 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.421751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:40.422526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.422960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:40.446946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:00:40.525859 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bb1fb4ec-7f88-4d15-8f2c-0376b32c1858 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 204 len: 0 microversion: 2.1 time: 0.114443 Jan 11 04:00:40.526529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 264/515] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:00:40 2022] DELETE /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:00:40.535366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:40.536050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:40.548995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.549434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:40.550251 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.550686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:40.681146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:40.689209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a6f206c8-8ba6-4be6-81a4-53c07eb0d324 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.158029 Jan 11 04:00:40.689911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 252/516] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:40 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:40.985218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:40.986353 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:40.992089 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.992541 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:40.993316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:40.993786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:41.017583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'flavor' on Instance uuid 376b0310-ef7d-4609-ba47-c79f9805555b {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:00:41.122521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6dec620a-5f5a-492b-97f0-9997e04b166d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action" status: 200 len: 32 microversion: 2.1 time: 0.142224 Jan 11 04:00:41.123134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 265/517] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:40 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:00:41.131851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:41.132481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:41.139294 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:41.139767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:41.140550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:41.141014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:41.345910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:41.353135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-29307ed5-a6a5-46ea-a83a-596888796e1f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.225030 Jan 11 04:00:41.353709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 253/518] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:41 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:41.708937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:41.710427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:41.724841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:41.725302 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:41.726146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:41.726753 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:41.877879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:41.885206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c89a8988-9092-44e0-9289-f732ccc567c4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.181613 Jan 11 04:00:41.885894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 266/519] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:41 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:42.369357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:42.369988 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:42.376694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:42.377136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:42.377932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:42.378365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:42.506968 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:42.514709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6d585ef9-58f2-4e67-85aa-140ba59945df tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.148978 Jan 11 04:00:42.515268 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 254/520] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:42 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:42.902624 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:42.903224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:42.909806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:42.910252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:42.911022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:42.911451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:43.037721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:43.045052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2801c9ee-f7be-4b85-8a4d-174baa66fd61 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.146504 Jan 11 04:00:43.045626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 267/521] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:42 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:43.531700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:43.532305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:43.538554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:43.539000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:43.539773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:43.540211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:43.672071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:43.679439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6f443d4b-682e-44f4-ba9a-88babe0609f9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.151602 Jan 11 04:00:43.680005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 255/522] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:43 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:44.062154 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:44.062763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:44.068938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:44.069404 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:44.070204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:44.070647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:44.196264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:44.203839 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-059c9ed5-ede8-4713-8074-4195c4468cf6 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.146024 Jan 11 04:00:44.204402 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 268/523] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:44 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:44.695787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:44.696395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:44.703154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:44.703602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:44.704469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:44.704976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:44.830175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:44.837430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-093cb218-a5c5-48f3-8c05-35314c067d24 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.145157 Jan 11 04:00:44.838033 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 256/524] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:44 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:45.220232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:45.220755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:45.227048 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:45.227496 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:45.228269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:45.228705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:45.358918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:45.366025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f60e1467-dee9-4a42-8c84-7eee5e1add0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.149472 Jan 11 04:00:45.366584 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 269/525] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:45 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:45.854356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:45.854996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:45.861253 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:45.861719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:45.862504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:45.862941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:45.993304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:46.001025 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b3a8129b-8d53-4e07-98e8-8da476ea35e5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.150324 Jan 11 04:00:46.001609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 257/526] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:45 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:46.382412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:46.383044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:46.390006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:46.390452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:46.391216 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:46.391644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:46.525485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:46.533516 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-239d2f14-1176-40b3-9f23-4de28388dc67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.154665 Jan 11 04:00:46.534094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 270/527] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:46 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:47.017226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:47.017893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:47.024222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:47.024682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:47.025495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:47.025981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:47.153107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:47.160499 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-284cbbbb-d760-4601-9308-637db27aecf6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.146883 Jan 11 04:00:47.161060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 258/528] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:47 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:47.550535 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:47.551856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:47.558567 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:47.559017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:47.559905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:47.560306 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:47.692224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:47.701855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f7fa68b0-5fd1-42f9-8866-9f9102f5ce0e tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.154921 Jan 11 04:00:47.702409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 271/529] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:47 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:48.177857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:48.178378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:48.184511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:48.184952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:48.185739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:48.186178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:48.311326 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:48.318561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b54307e9-d1a3-4570-9b3b-962eb10c0764 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.144386 Jan 11 04:00:48.319144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 259/530] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:48 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:48.718274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:48.718908 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:48.725199 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:48.725665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:48.726448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:48.726885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:48.853954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:48.861771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ce489b90-658c-48df-9e44-1a894f257f0d tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1514 microversion: 2.1 time: 0.147637 Jan 11 04:00:48.862336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 272/531] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:48 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:49.170777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:00:49.171002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:00:49.335343 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:49.335978 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:49.342804 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.343250 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.344062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.344496 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.441122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-1ffda184-2be8-43ba-8722-9c9ebd0025e0 req-d87aa830-182f-453b-a4df-c78c341f9d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049756f8-45e1-48c5-9503-67b2a9e2ced4", "name": "network-vif-deleted", "tag": "b1fe0740-97fc-43bd-a247-f5c19d3fd577"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:49.444360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:49.444360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:49.455430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1ffda184-2be8-43ba-8722-9c9ebd0025e0 req-d87aa830-182f-453b-a4df-c78c341f9d1a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.455960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1ffda184-2be8-43ba-8722-9c9ebd0025e0 req-d87aa830-182f-453b-a4df-c78c341f9d1a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.467743 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-1ffda184-2be8-43ba-8722-9c9ebd0025e0 req-d87aa830-182f-453b-a4df-c78c341f9d1a service nova] Creating event network-vif-deleted:b1fe0740-97fc-43bd-a247-f5c19d3fd577 for instance 049756f8-45e1-48c5-9503-67b2a9e2ced4 on hv-cinder-81977 Jan 11 04:00:49.472864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-1ffda184-2be8-43ba-8722-9c9ebd0025e0 req-d87aa830-182f-453b-a4df-c78c341f9d1a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035413 Jan 11 04:00:49.473554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 273/532] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:49.511521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:49.519014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7aa4537d-dae0-4246-9cc2-6a43e0c9debc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.187268 Jan 11 04:00:49.519586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 260/533] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:49 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:49.878934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:49.879635 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:49.885483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.886463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.887248 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.887684 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.920568 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:49.921245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:49.922056 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lazy-loading 'fault' on Instance uuid 049756f8-45e1-48c5-9503-67b2a9e2ced4 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:00:49.967673 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:49.975128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6521e5d0-2825-4b7a-b56a-5d683ff7936c tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 200 len: 1308 microversion: 2.1 time: 0.100596 Jan 11 04:00:49.975689 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 274/534] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:49 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:50.536554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:50.537286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:50.544214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:50.544662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:50.545441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:50.545932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:50.686946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:50.694625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-70acd163-e455-4050-84d7-b3b792e5db62 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.161693 Jan 11 04:00:50.695193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 261/535] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:50 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:50.991460 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:50.992077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 049756f8-45e1-48c5-9503-67b2a9e2ced4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:50.998477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:50.999109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:50.999932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.000374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.014340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Instance 049756f8-45e1-48c5-9503-67b2a9e2ced4 could not be found. Jan 11 04:00:51.014917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 404 to user: Instance 049756f8-45e1-48c5-9503-67b2a9e2ced4 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:00:51.015766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f7719871-51ad-4e8b-a721-0a883aee5586 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4" status: 404 len: 111 microversion: 2.1 time: 0.027961 Jan 11 04:00:51.016309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 275/536] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:50 2022] GET /compute/v2.1/servers/049756f8-45e1-48c5-9503-67b2a9e2ced4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:00:51.049314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-be20f5fa-272e-4f18-bd94-2e50b9452892 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:51.056137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be20f5fa-272e-4f18-bd94-2e50b9452892 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.056656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be20f5fa-272e-4f18-bd94-2e50b9452892 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.119359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-be20f5fa-272e-4f18-bd94-2e50b9452892 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Going to try to stop instance {{(pid=116387) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 11 04:00:51.161837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-be20f5fa-272e-4f18-bd94-2e50b9452892 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 202 len: 0 microversion: 2.1 time: 0.116021 Jan 11 04:00:51.162443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 262/537] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:51 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:00:51.170915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:51.171597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:51.177540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.178167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.178950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.179537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.309526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:51.317429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-796145b3-be92-498d-9b3a-ab772421379a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.150817 Jan 11 04:00:51.318020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 276/538] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:51 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:51.711505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:51.712209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:51.718620 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.719071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.719856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:51.720289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:51.855231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:51.862777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3f470748-927f-408f-a306-ec64cf62dae2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.155251 Jan 11 04:00:51.863345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 263/539] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:51 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:52.145235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:52.145752 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:52.152480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.152949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.154058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.154494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.178780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:00:52.251119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3fa973f3-59f3-49d7-b57a-30be0fdfbefc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 204 len: 0 microversion: 2.1 time: 0.109237 Jan 11 04:00:52.251751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 277/540] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:00:52 2022] DELETE /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:00:52.259556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:52.260158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:52.265970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.266416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.267197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.267637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.335755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:52.336592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:52.342364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.342958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.343622 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.344050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.421337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:52.429035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b2061511-a2f1-45ec-8d6d-a83cad865212 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1513 microversion: 2.1 time: 0.173015 Jan 11 04:00:52.430140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 264/541] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:52 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:52.495917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:52.504118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-deb6b9dd-510f-4f25-85f6-4888917d0466 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.172740 Jan 11 04:00:52.504685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 278/542] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:52 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:52.879880 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:52.880467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:52.887110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.887558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:52.888326 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:52.888759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:53.016150 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:53.028334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b8353396-3c75-41bf-b738-1bb5bd2c4842 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.151831 Jan 11 04:00:53.029429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 265/543] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:52 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:53.445644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:53.446277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:53.453125 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:53.453580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:53.454405 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:53.454852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:53.520903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:53.521506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:53.527754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:53.528198 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:53.529233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:53.529662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:53.628741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:53.636192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7a1ce514-0f33-40e9-ad11-083b1a83dd90 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1513 microversion: 2.1 time: 0.194381 Jan 11 04:00:53.636766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 279/544] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:53 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:53.693800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:53.702262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d0594411-e767-4ca8-b0e0-55a7024e0f06 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.184961 Jan 11 04:00:53.702831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 266/545] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:53 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:54.045341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:54.046006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:54.051787 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.052242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.053026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.053487 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.180074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:54.187937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d6fcc317-9fbc-41dc-bf83-a724ad9c5c0b tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.146567 Jan 11 04:00:54.188521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 280/546] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:54 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:54.345961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1563285253", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-228509899", "security_groups": [{"name": "tempest-secgroup-smoke-2045754446"}], "networks": [{"uuid": "117c920f-00e2-46fd-99e4-9df0063bcc75"}], "block_device_mapping_v2": [{"uuid": "9a31c2ae-6852-49df-b383-e84da2937393", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:54.453105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] validate_networks() for [('117c920f-00e2-46fd-99e4-9df0063bcc75', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:00:54.654201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:54.655175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:54.661813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.662560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.663460 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.664000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.936047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:54.946115 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:00:54.946567 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:00:54.947049 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:00:54.947456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:00:54.947928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:00:54.950532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-17f2c2d9-659d-4130-9576-5b129cd09625 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1513 microversion: 2.1 time: 0.293926 Jan 11 04:00:54.959904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 281/547] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:54 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:54.960078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.960078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.960078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.960078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.964055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:54.964713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:54.970782 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.971240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.972030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:54.972467 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:54.978887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:00:54.983540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Getting quotas for user 9a2cd37f07db460081345374727b0e4d and project c65441ebedff4d1eb294ecdd3dd8e56d. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:00:55.043862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:00:55.046083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a31c2ae-6852-49df-b383-e84da2937393',volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:00:55.118920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:55.127411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-69693deb-142a-47d7-9816-a7e65f5b782f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.175054 Jan 11 04:00:55.128265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 282/548] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:54 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:55.175653 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ff5c5b3b-718d-480d-92e8-d226de0e3719 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833426 Jan 11 04:00:55.177824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 267/549] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:00:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:00:55.189118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8d3e30ef-2685-4c70-9dce-5f66ced4ff1c tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:55.196413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8d3e30ef-2685-4c70-9dce-5f66ced4ff1c tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:55.221361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:55.222262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:55.228970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:55.229958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:55.230935 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:55.231537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:55.262363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8d3e30ef-2685-4c70-9dce-5f66ced4ff1c tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:55.269940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8d3e30ef-2685-4c70-9dce-5f66ced4ff1c tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1088 microversion: 2.1 time: 0.084453 Jan 11 04:00:55.270691 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 283/550] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:55 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:55.429738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:55.440345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ac32c213-96b8-4c1e-8ce4-9caff9b3a497 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.220138 Jan 11 04:00:55.440345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 268/551] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:55 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:55.964679 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-beac41a1-6a01-4a6c-b252-b2c8d2fb25da req-491176fa-558d-48c5-ad91-1ecd2d29904d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a", "name": "network-vif-deleted", "tag": "ed1f299c-e5e8-4863-85fb-355b36611b4b"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:55.966468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:55.967071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:55.967629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:55.967629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:00:55.976446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:55.976897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:55.977795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:55.978227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:55.979463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-beac41a1-6a01-4a6c-b252-b2c8d2fb25da req-491176fa-558d-48c5-ad91-1ecd2d29904d service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:55.980015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-beac41a1-6a01-4a6c-b252-b2c8d2fb25da req-491176fa-558d-48c5-ad91-1ecd2d29904d service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:55.999978 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-beac41a1-6a01-4a6c-b252-b2c8d2fb25da req-491176fa-558d-48c5-ad91-1ecd2d29904d service nova] Creating event network-vif-deleted:ed1f299c-e5e8-4863-85fb-355b36611b4b for instance b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a on hv-cinder-81977 Jan 11 04:00:56.008412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-beac41a1-6a01-4a6c-b252-b2c8d2fb25da req-491176fa-558d-48c5-ad91-1ecd2d29904d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050214 Jan 11 04:00:56.009727 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 284/552] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:56.064729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:56.071945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e2a88edc-c127-476a-b3c0-af8294255ffc tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 200 len: 1471 microversion: 2.1 time: 0.109587 Jan 11 04:00:56.072679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 269/553] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:55 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:56.145361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:56.146396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:56.152843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.153501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.154580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.155016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.288474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:56.289059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:56.291554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:56.295316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.295833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.296684 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.297191 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.299792 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-168c604e-4d93-4cd1-bc1a-f87e1df28249 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.158425 Jan 11 04:00:56.300614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 285/554] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:56 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:56.365396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:56.380397 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8b6533e1-e989-49d3-a94b-051820424cff tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1186 microversion: 2.1 time: 0.095957 Jan 11 04:00:56.381716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 270/555] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:56 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:56.454630 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:56.455240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:56.461629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.462628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.463417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:56.464154 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:56.691239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:56.701174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2ee850db-af6b-480f-b331-76fe5eac2d04 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.248966 Jan 11 04:00:56.710677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 286/556] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:56 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:57.089261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.090612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.101192 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.101898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.102685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.103282 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.117600 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Instance b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a could not be found. Jan 11 04:00:57.118243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 404 to user: Instance b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:00:57.119234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0d386d6c-e8d8-40e1-94b1-f43e70f7dfc4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a" status: 404 len: 111 microversion: 2.1 time: 0.034845 Jan 11 04:00:57.119802 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 271/557] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:57 2022] GET /compute/v2.1/servers/b9e38a40-62c3-4842-a7a0-6a3dd1b27c1a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:00:57.127576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.128078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.141300 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.142283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.143459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.144033 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.172059 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:00:57.250215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-823bd21a-1679-4160-9dd8-6692bf053cd9 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 204 len: 0 microversion: 2.1 time: 0.125894 Jan 11 04:00:57.251137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 287/558] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:00:57 2022] DELETE /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:00:57.259226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.259838 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.266795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.267249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.268047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.268482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.318530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.319231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.326098 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.326561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.327394 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.328137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.514991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:57.522306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b860d3e8-0951-4cb4-bd04-8d47ac65f518 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1513 microversion: 2.1 time: 0.267296 Jan 11 04:00:57.522869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 272/559] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:57 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:57.532153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.532153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.533731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.534187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.535000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.535534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.631956 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:57.640139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c4661dcd-5ce1-4420-a152-565539a12bca tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.325963 Jan 11 04:00:57.640716 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 288/560] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:57 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:57.718777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:57.720231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.732238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.732770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.733975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.734508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.845359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:57.852682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3ebd36bc-9424-4b93-ad8b-85ccb6bbdcf2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1272 microversion: 2.1 time: 0.328776 Jan 11 04:00:57.853333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 273/561] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:57 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:57.964160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:57.971425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0cd68faa-285d-46fa-9e02-97449fca64bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1500 microversion: 2.1 time: 0.256962 Jan 11 04:00:57.971999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 289/562] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:57 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:57.987708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f8f8025-5146-4a4a-b9d1-dfdafbac89f4"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:57.988806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:57.994502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.995684 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:57.996461 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:57.996888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.020031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] HTTP exception thrown: Cannot 'attach_volume' instance 376b0310-ef7d-4609-ba47-c79f9805555b while it is in vm_state rescued Jan 11 04:00:58.020609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Returning 409 to user: Cannot 'attach_volume' instance 376b0310-ef7d-4609-ba47-c79f9805555b while it is in vm_state rescued {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:00:58.021414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1a1a84c2-6d76-4653-9f12-4f9a830f8a71 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037519 Jan 11 04:00:58.021983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 274/563] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:00:57 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 11 04:00:58.030984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:58.031766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:58.037938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.038388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.039423 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.039866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.119604 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a522ca31-94d9-4648-a5aa-6c93dcb1e9a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action" status: 202 len: 0 microversion: 2.1 time: 0.092612 Jan 11 04:00:58.123552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 290/564] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:00:58 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:00:58.129513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:58.130151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:58.154217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.154802 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.155979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.156532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.541140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:58.542514 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:58.548553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.549008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.549830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.550271 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.788218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:58.797283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8bbcc96b-c9ce-424c-9008-acdc5659f66d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1508 microversion: 2.1 time: 0.671488 Jan 11 04:00:58.798115 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 275/565] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:58 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:58.803632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-3f619075-9057-418a-9f6e-482633c64eb7 req-2425f969-577b-4aff-86eb-fef4f9cb3496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:00:58.805408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:00:58.805408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:00:58.813456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-3f619075-9057-418a-9f6e-482633c64eb7 req-2425f969-577b-4aff-86eb-fef4f9cb3496 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.814470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-3f619075-9057-418a-9f6e-482633c64eb7 req-2425f969-577b-4aff-86eb-fef4f9cb3496 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.833256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-3f619075-9057-418a-9f6e-482633c64eb7 req-2425f969-577b-4aff-86eb-fef4f9cb3496 service nova] Creating event network-changed:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:00:58.839986 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-3f619075-9057-418a-9f6e-482633c64eb7 req-2425f969-577b-4aff-86eb-fef4f9cb3496 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040518 Jan 11 04:00:58.842644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 276/566] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:00:58.858017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:58.864355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:58.872157 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.872797 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:58.874114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:58.874703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:59.001668 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:59.016666 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6b91afdd-54b2-4f0d-926d-d66bdc63d10a tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1513 microversion: 2.1 time: 0.479809 Jan 11 04:00:59.027461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 291/567] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:58 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:00:59.034758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:59.035778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:59.042803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:59.043573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:59.044592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:59.045127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:59.247634 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:59.255681 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e99d975d-d9aa-46b7-85ff-8a1372d3d82a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.405387 Jan 11 04:00:59.256461 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 277/568] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:58 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:59.445582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:00:59.455170 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e6dddd83-cd09-4dd1-9171-7de8cc8d044a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.426123 Jan 11 04:00:59.456006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 292/569] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:59 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:00:59.814342 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:00:59.814951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:00:59.821140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:59.821582 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:00:59.822384 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:00:59.822853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.034335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:00.034952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:00.041240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.042271 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.043051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.043490 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.136329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:00.143938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-151de204-724a-4bf2-95d5-a0192bbb3652 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1508 microversion: 2.1 time: 0.333150 Jan 11 04:01:00.144540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 278/570] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:00:59 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:00.272693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:00.273383 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:00.280859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.281497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.282385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.282815 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.364707 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:00.372488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2968e302-8471-4d6c-b18b-a30af99db8e8 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 200 len: 1513 microversion: 2.1 time: 0.341801 Jan 11 04:01:00.373056 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 293/571] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:00 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:00.472084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:00.473328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:00.479444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.479889 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.481395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.481867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.646850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:00.654832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b8a4c2fc-aa92-4c83-bba2-0353a094389d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.385848 Jan 11 04:01:00.655400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 279/572] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:00 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:00.734369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:00.741640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-18736bb2-9cad-4e39-b814-fcded9bf255d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.273306 Jan 11 04:01:00.742225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 294/573] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:00 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:00.861470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-e6f93db1-82b7-469f-8716-8a6c417bd377 req-c5cfa535-5d9e-46a1-a670-2d2aa05a47b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ced3c-faf4-4d73-b902-1ef3ac691e95", "name": "network-vif-deleted", "tag": "d4f8259b-4d3a-4936-a0d2-6e73645429bd"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:00.863042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:01:00.863042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:01:00.870709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e6f93db1-82b7-469f-8716-8a6c417bd377 req-c5cfa535-5d9e-46a1-a670-2d2aa05a47b3 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:00.871197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e6f93db1-82b7-469f-8716-8a6c417bd377 req-c5cfa535-5d9e-46a1-a670-2d2aa05a47b3 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:00.881566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-e6f93db1-82b7-469f-8716-8a6c417bd377 req-c5cfa535-5d9e-46a1-a670-2d2aa05a47b3 service nova] Creating event network-vif-deleted:d4f8259b-4d3a-4936-a0d2-6e73645429bd for instance fa0ced3c-faf4-4d73-b902-1ef3ac691e95 on hv-cinder-81977 Jan 11 04:01:00.886787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-e6f93db1-82b7-469f-8716-8a6c417bd377 req-c5cfa535-5d9e-46a1-a670-2d2aa05a47b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028959 Jan 11 04:01:00.887349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 280/574] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:01:01.160757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:01.161373 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:01.168501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.168848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.169702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.170138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.308776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:01.316548 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1c45d41d-dcbe-4cbc-85bd-66cbca507b4e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1508 microversion: 2.1 time: 0.159341 Jan 11 04:01:01.317116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 295/575] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:01 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:01.389063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:01.389785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: fa0ced3c-faf4-4d73-b902-1ef3ac691e95] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:01.395833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.396283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.397054 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.397495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.410934 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Instance fa0ced3c-faf4-4d73-b902-1ef3ac691e95 could not be found. Jan 11 04:01:01.411440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 404 to user: Instance fa0ced3c-faf4-4d73-b902-1ef3ac691e95 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:01:01.412239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d4f5f508-8b8b-4717-b7b9-b96965ffc77f tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95" status: 404 len: 111 microversion: 2.1 time: 0.027206 Jan 11 04:01:01.412743 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 281/576] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:01 2022] GET /compute/v2.1/servers/fa0ced3c-faf4-4d73-b902-1ef3ac691e95 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:01:01.671262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:01.671790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:01.677597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.678078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.678846 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.679278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.758470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:01.759593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:01.766285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.766735 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.767514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:01.767940 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:01.805404 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:01.814123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8e0e7ea8-9b19-4824-a6b0-b55a7212bc5c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.146419 Jan 11 04:01:01.814720 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 296/577] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:01 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:01.913292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:01.921545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-79240261-6b47-4fec-a86a-3f6e5db6e09a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.166550 Jan 11 04:01:01.922098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 282/578] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:01 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:02.333066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:02.333710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:02.340129 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.340578 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.341357 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.341837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.467103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:02.474572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ff16e370-7324-4b75-8175-863a32a9a827 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1508 microversion: 2.1 time: 0.145097 Jan 11 04:01:02.475139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 297/579] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:02 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:02.535891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:02.536380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:02.542676 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.543144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.543908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.544333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.569759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:01:02.644334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-33303e50-c9a6-4738-a984-0d27f5089bd4 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "DELETE /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 204 len: 0 microversion: 2.1 time: 0.111462 Jan 11 04:01:02.645911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 283/580] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:01:02 2022] DELETE /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:01:02.653270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:02.654528 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:02.660863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.661307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.662333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.662768 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.799269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:02.806758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eea79955-0ee6-4630-b812-9cf3bf8ecb67 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1514 microversion: 2.1 time: 0.157201 Jan 11 04:01:02.808003 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 298/581] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:02 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:02.831648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:02.832351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:02.838317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.838772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.839557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.839996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.937914 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:02.938624 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:02.945865 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.946401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.948146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:02.948832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:02.982903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:02.990770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-95b9dbe6-3c3e-429b-99d4-2c68e321fddf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.163046 Jan 11 04:01:02.991357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 284/582] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:02 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:03.083111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:03.090975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-17e0d160-a059-4955-aec4-29fc418d9fdc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.156958 Jan 11 04:01:03.091533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 299/583] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:02 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:03.491286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:03.491930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:03.498583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:03.499037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:03.499819 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:03.500261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:03.629893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:03.637027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8e41dd1d-28bc-477f-9037-d964a04f9914 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1514 microversion: 2.1 time: 0.149386 Jan 11 04:01:03.637589 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 285/584] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:03 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:03.824139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:03.824745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:03.846749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:03.847356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:03.848188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:03.848616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:03.986875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:03.994029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-25c84f3d-c3d6-45d7-930a-6e93499bc0c7 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1514 microversion: 2.1 time: 0.173498 Jan 11 04:01:03.994616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 300/585] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:03 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:04.007322 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:04.007943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:04.014848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.015266 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:04.016043 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.016480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:04.107207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:04.108055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:04.113927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.114450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:04.115308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.115834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:04.146136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:04.154946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b6b9268d-e575-4041-8243-8ff6122166c8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.151243 Jan 11 04:01:04.155602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 286/586] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:04 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:04.242102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:04.250156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7875e648-14b8-4520-b234-80ec1a1635ed tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.146422 Jan 11 04:01:04.250870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 301/587] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:04 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:04.940395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:04.941004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:04.946751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.947196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:04.947969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:04.948404 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.011017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:05.011610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:05.017943 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.018384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.019158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.019583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.340321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:05.347652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-35ec9c01-b4f9-426a-bf43-4f2b3435ff29 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1514 microversion: 2.1 time: 0.410834 Jan 11 04:01:05.348220 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 287/588] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:04 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:05.352439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:05.353035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:05.359476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.359923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.360704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.361140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.500397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:05.508055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-264ba131-a7c9-492b-b863-643aebdda356 tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1514 microversion: 2.1 time: 0.501137 Jan 11 04:01:05.508633 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 302/589] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:05 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1514 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:05.512837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:05.513439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:05.519344 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.519802 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.520591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.521026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.606622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:05.614219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e1833064-b87a-4f53-93aa-2ba6cc04ef29 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.265045 Jan 11 04:01:05.614779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 288/590] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:05 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:05.619233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbd855af-ddac-4457-84cb-218b5ec1cc0a"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:05.620943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:05.626544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.626987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.627758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.628189 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.754298 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:05.762019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f0c8a4b9-7edc-49ca-9db4-8c7eb1f826df tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.252372 Jan 11 04:01:05.762595 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 303/591] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:05 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:05.894543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6ff33614-953b-4ed0-a407-baf61072e5f0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278384 Jan 11 04:01:05.895193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 289/592] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:01:05 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:01:05.977341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-d01544de-40c5-45a6-adf8-d16bc4cea9ed req-21c6e7e6-3851-41e2-8b32-29404c408e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4", "name": "network-vif-deleted", "tag": "4656f61c-2c13-453b-a68e-993e311d96cb"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:05.980072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:01:05.980072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:01:05.987231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-d01544de-40c5-45a6-adf8-d16bc4cea9ed req-21c6e7e6-3851-41e2-8b32-29404c408e4b service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:05.987704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-d01544de-40c5-45a6-adf8-d16bc4cea9ed req-21c6e7e6-3851-41e2-8b32-29404c408e4b service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:05.999796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-d01544de-40c5-45a6-adf8-d16bc4cea9ed req-21c6e7e6-3851-41e2-8b32-29404c408e4b service nova] Creating event network-vif-deleted:4656f61c-2c13-453b-a68e-993e311d96cb for instance 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 on hv-cinder-81977 Jan 11 04:01:06.005519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-d01544de-40c5-45a6-adf8-d16bc4cea9ed req-21c6e7e6-3851-41e2-8b32-29404c408e4b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 Jan 11 04:01:06.006547 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 304/593] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:01:06.525433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:06.526659 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:06.532994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.533446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.534272 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.534713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.563591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.564039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.564491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lazy-loading 'fault' on Instance uuid 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:01:06.603239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dcd5f80a739403ab7577cc398ba0754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c5a36c198849fb8c8fce04cd34151b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:06.611266 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9b100bd5-7de7-4f0d-aa80-5a9b723e65fb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 200 len: 1308 microversion: 2.1 time: 0.090314 Jan 11 04:01:06.611824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 290/594] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:06 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:06.631874 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:06.632596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:06.639492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.639950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.640736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.641393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.779046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:06.780405 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:06.781017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:06.787300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.787750 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.788536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:06.788861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1d7258f2-4dd4-461f-94a5-c36030904f1c tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1721 microversion: 2.1 time: 0.161472 Jan 11 04:01:06.788994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:06.789435 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 305/595] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:06 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:06.925292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:06.933295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f3fefa8b-987b-43e4-b4de-a59935d50179 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.156675 Jan 11 04:01:06.933888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 291/596] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:06 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:07.628213 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:07.628818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] [instance: 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:07.635163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.635706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.636380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.636816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.649481 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] HTTP exception thrown: Instance 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 could not be found. Jan 11 04:01:07.650087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] Returning 404 to user: Instance 385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:01:07.651428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-47a09374-a551-46cc-bb40-351ab3e066eb tempest-AttachVolumeNegativeTest-2056760451 tempest-AttachVolumeNegativeTest-2056760451-project] 10.222.0.24 "GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4" status: 404 len: 111 microversion: 2.1 time: 0.026341 Jan 11 04:01:07.651931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 306/597] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:07 2022] GET /compute/v2.1/servers/385371ee-d0b6-40bb-af9e-3d4eb9a5d5d4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:01:07.805587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:07.806300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:07.813370 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.813856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.814871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.815526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.947546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:07.951350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:07.952008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:07.956231 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-aadd5fca-1e98-46eb-b7ad-bf2a9637c5d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1698 microversion: 2.1 time: 0.154319 Jan 11 04:01:07.957100 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 292/598] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:07 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:07.963261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.964425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.965321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.966016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:07.972894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-54392055-e61f-45bd-a542-487d0cfe924b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:07.978964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54392055-e61f-45bd-a542-487d0cfe924b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:07.979431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54392055-e61f-45bd-a542-487d0cfe924b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:08.001946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-54392055-e61f-45bd-a542-487d0cfe924b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Going to try to start instance {{(pid=116387) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 11 04:01:08.052759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-54392055-e61f-45bd-a542-487d0cfe924b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 202 len: 0 microversion: 2.1 time: 0.083265 Jan 11 04:01:08.056586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 293/599] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:01:07 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:01:08.062287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:08.062963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:08.069596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:08.070197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:08.071045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:08.071480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:08.140741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:08.149163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-07dfa93e-de05-4158-9e4b-001d543fa530 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.202009 Jan 11 04:01:08.155159 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 307/600] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:07 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:08.271224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:08.279212 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1760c2a4-55ba-42fc-a0f1-12c87494e9e3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1707 microversion: 2.1 time: 0.221131 Jan 11 04:01:08.280005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 294/601] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:08 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1707 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:09.167405 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:09.168009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:09.174111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:09.174555 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:09.175325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:09.175760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:09.295079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:09.295835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:09.303586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:09.304121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:09.305313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:09.305962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:09.311903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:09.319700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0651e4b1-061c-467e-a2f2-ba5b09eea5a3 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.156306 Jan 11 04:01:09.321744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 308/602] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:09 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:09.436857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:09.444734 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a006f894-7a22-4834-b071-33ae377259bf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1707 microversion: 2.1 time: 0.153318 Jan 11 04:01:09.445488 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 295/603] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:09 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:10.336103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:10.336708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:10.342923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:10.343365 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:10.344136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:10.344598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:10.463766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:10.464879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:10.471081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:10.471525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:10.472335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:10.472765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:10.478623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:10.486400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a2dd690d-407b-42e1-828c-fac0a8ce3ca9 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.153980 Jan 11 04:01:10.486964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 309/604] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:10 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:10.598454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:10.606836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e9699cd1-b326-4522-8c7a-9b5abda10c88 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1711 microversion: 2.1 time: 0.148022 Jan 11 04:01:10.607400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 296/605] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:10 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1711 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:11.502610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:11.503412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:11.509455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:11.509940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:11.510726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:11.511161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:11.640999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:11.648162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-185b0f7b-6a4c-4c80-8d2d-1ebb77b03a57 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.149261 Jan 11 04:01:11.648736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 310/606] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:11 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:12.402079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-e7800791-7779-474e-9a4a-b1b61ec7ea49 req-af7f3e75-79cd-457e-99b2-34ed214c96a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "name": "network-vif-plugged", "status": "completed", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:12.403665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:01:12.403665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:01:12.411729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e7800791-7779-474e-9a4a-b1b61ec7ea49 req-af7f3e75-79cd-457e-99b2-34ed214c96a6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:12.412181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e7800791-7779-474e-9a4a-b1b61ec7ea49 req-af7f3e75-79cd-457e-99b2-34ed214c96a6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:12.423891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-e7800791-7779-474e-9a4a-b1b61ec7ea49 req-af7f3e75-79cd-457e-99b2-34ed214c96a6 service nova] Creating event network-vif-plugged:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:01:12.428785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-e7800791-7779-474e-9a4a-b1b61ec7ea49 req-af7f3e75-79cd-457e-99b2-34ed214c96a6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 Jan 11 04:01:12.429532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 297/607] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:01:12.664348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:12.664962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:12.671731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:12.672382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:12.673190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:12.673629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:12.812702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:12.820223 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7a099703-1630-4381-9e55-f251b892a6b0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.159629 Jan 11 04:01:12.820780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 311/608] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:12 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:13.838726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:13.839424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:13.845500 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:13.845973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:13.846744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:13.847169 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:13.980850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:13.988185 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b192488b-388c-44ee-9157-1d93e167936e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.154864 Jan 11 04:01:13.988683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 298/609] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:13 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:15.004185 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:15.004730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:15.011059 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:15.011504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:15.012274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:15.012828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:15.139867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:15.147050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1a596fcc-fee0-41c8-b430-a53bc2e88a00 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.146587 Jan 11 04:01:15.147613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 312/610] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:14 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:16.164081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:16.164688 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:16.171561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:16.171946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:16.172704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:16.173140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:16.301391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:16.309223 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6634a215-518d-4dc8-9286-cf708ca2da02 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.148849 Jan 11 04:01:16.309813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 299/611] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:16 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:17.325188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:17.325813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:17.332047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:17.332494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:17.333263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:17.333712 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:17.459642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:17.467272 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-403d244d-b991-4584-8f65-2cc7e060e5b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.145742 Jan 11 04:01:17.467899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 313/612] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:17 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:18.484064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:18.484609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:18.490919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.491373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:18.492160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.492626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:18.625830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:18.634443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2aea825e-b10e-4c44-9fad-2c3c6ddb47a2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1260 microversion: 2.1 time: 0.153876 Jan 11 04:01:18.635128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 300/613] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:18 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:18.811926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:18.812899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:18.819161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.819617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:18.820399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.820837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:18.843332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'flavor' on Instance uuid 376b0310-ef7d-4609-ba47-c79f9805555b {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:01:18.959410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c1c61569-9453-4149-976b-c3ce2e7ce123 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action" status: 200 len: 32 microversion: 2.1 time: 0.151212 Jan 11 04:01:18.960018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 314/614] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:01:18 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:01:18.969289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:18.970066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:18.975928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.976382 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:18.977170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:18.977601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:19.192666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:19.201323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e8485132-3e7b-4c78-be68-3b1d3323b62e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.235575 Jan 11 04:01:19.201933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 301/615] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:18 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:19.650888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:19.651596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:19.657886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:19.658347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:19.659138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:19.659580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:19.801606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:19.809794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-36c2e8c6-7ea7-44fb-8438-9a71e99131af tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1443 microversion: 2.1 time: 0.162883 Jan 11 04:01:19.810396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 315/616] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:19 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:19.825116 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:19.825751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:19.832273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:19.832720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:19.833492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:19.833947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:19.964451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:19.971994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-82c44d4b-c220-4b5c-8901-ebd7f4764172 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1443 microversion: 2.1 time: 0.150383 Jan 11 04:01:19.972553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 302/617] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:19 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:20.218711 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:20.219259 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:20.225488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:20.225983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:20.226779 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:20.227225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:20.415431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:20.423878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6a8a85aa-6ede-4239-b883-27f56223e530 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.208961 Jan 11 04:01:20.424451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 316/618] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:20 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:01:21.440766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:21.441346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:21.448240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:21.448692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:21.450072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:21.450605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:21.673485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:21.682277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dc1af2f2-0247-487b-b38b-5978b21000a8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.244830 Jan 11 04:01:21.683018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 303/619] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:21 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:22.134114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-2789b5c9-35ae-435a-a16b-f5a7d8a4cd1c req-072d947c-356f-42ba-8b08-993f0e59549e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:22.134114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:01:22.134114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:01:22.142009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-2789b5c9-35ae-435a-a16b-f5a7d8a4cd1c req-072d947c-356f-42ba-8b08-993f0e59549e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:22.142543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-2789b5c9-35ae-435a-a16b-f5a7d8a4cd1c req-072d947c-356f-42ba-8b08-993f0e59549e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:22.164786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-2789b5c9-35ae-435a-a16b-f5a7d8a4cd1c req-072d947c-356f-42ba-8b08-993f0e59549e service nova] Creating event network-changed:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:01:22.171162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-2789b5c9-35ae-435a-a16b-f5a7d8a4cd1c req-072d947c-356f-42ba-8b08-993f0e59549e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041903 Jan 11 04:01:22.172195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 317/620] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:01:22.699228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:22.699904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:22.706515 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:22.707001 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:22.708102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:22.708543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:22.843987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:22.851790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-771290b5-f9e7-4aa5-a6d4-4aee1668f1a6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.156806 Jan 11 04:01:22.852353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 304/621] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:22 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:23.869773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:23.870462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:23.876438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:23.876883 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:23.877656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:23.878113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:24.007698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:24.016007 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0d4e158b-9797-4177-8159-bb081a96f37f tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.150786 Jan 11 04:01:24.016564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 318/622] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:23 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:25.033090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:25.033714 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:25.039894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:25.040343 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:25.041152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:25.041586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:25.173337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:25.183035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-18917712-9f95-444a-88b9-b6abd4ba42c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.153855 Jan 11 04:01:25.183610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 305/623] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:25 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:26.199206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:26.199822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:26.206583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:26.207247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:26.208042 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:26.208479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:26.341482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:26.349307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c9579657-7a75-4adb-939f-0cfd85e243d9 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.153782 Jan 11 04:01:26.349885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 319/624] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:26 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:27.366362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:27.366984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:27.373706 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:27.374166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:27.374949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:27.375385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:27.509083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:27.517606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c11c6f3e-5368-4e8d-b727-27990fa360c2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.154819 Jan 11 04:01:27.518192 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 306/625] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:27 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:28.534295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:28.534905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:28.541097 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:28.541552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:28.542375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:28.542809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:28.670276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:28.678083 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6d9f0472-4548-44cd-9b7a-83977bf399a7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.147429 Jan 11 04:01:28.678642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 320/626] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:28 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:29.694506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:29.695130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:29.701297 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:29.701779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:29.702552 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:29.702985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:29.832494 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:29.840714 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c1e27207-3ffd-4414-80a6-40fb2edad1a1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.149866 Jan 11 04:01:29.841264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 307/627] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:29 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:30.857150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:30.857785 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:30.863960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:30.864401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:30.865185 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:30.865620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:30.998158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:31.006703 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-615cb106-b920-469a-b519-3c95288e2f35 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.153234 Jan 11 04:01:31.007264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 321/628] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:30 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:32.024455 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:32.025578 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:32.032979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:32.033426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:32.034254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:32.034723 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:32.169007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:32.176668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-af42bc36-5c31-4e27-b863-153e1c7df39a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.156684 Jan 11 04:01:32.177289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 308/629] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:32 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:33.193608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:33.194140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:33.200521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:33.200971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:33.201778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:33.202224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:33.332155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:33.340350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3d66f6b3-c60a-4bde-9bb3-67bce4ee39f7 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.150512 Jan 11 04:01:33.340919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 322/630] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:33 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:34.357787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:34.358430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:34.364648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:34.365099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:34.365917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:34.366359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:34.490464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:34.498859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c18041ca-14c1-431e-8be8-3ccb0d892301 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.145325 Jan 11 04:01:34.499422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 309/631] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:34 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:35.516674 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:35.517228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:35.523473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:35.523925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:35.524702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:35.525138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:35.652903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:35.660861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cc4f8af7-1a31-4058-8598-ad80d18a3b16 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.147932 Jan 11 04:01:35.661428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 323/632] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:35 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:36.677238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:36.677875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:36.684630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:36.685084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:36.685903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:36.686344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:36.811816 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:36.819647 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2ead99f5-00d0-486a-a542-5585c0ef14bd tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.146073 Jan 11 04:01:36.820213 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 310/633] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:36 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:37.836092 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:37.836703 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:37.842598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:37.843051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:37.843824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:37.844262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:37.969089 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:37.976830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9e944d31-3b6e-4f05-9c19-c827cf1c9767 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.144523 Jan 11 04:01:37.977389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 324/634] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:37 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:38.993142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:38.993784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:39.000069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:39.000519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:39.001296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:39.001761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:39.129170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:39.137334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5e481738-d65a-40c2-b017-66227b4e03f8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.147841 Jan 11 04:01:39.137918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 311/635] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:38 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:40.153606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:40.154613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:40.160853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:40.161297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:40.162099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:40.162528 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:40.287205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:40.295072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bea07130-a124-4fd1-be69-3f075e59e306 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.145087 Jan 11 04:01:40.295634 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 325/636] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:40 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:41.311493 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:41.312130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:41.318332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:41.318780 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:41.319565 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:41.319998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:41.453818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:41.461489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b19b91a6-fdd1-4a91-8872-31a04cc901eb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.153711 Jan 11 04:01:41.462092 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 312/637] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:41 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:42.478611 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:42.479283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:42.485954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:42.486403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:42.487221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:42.487659 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:42.626927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:42.634783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c7d91dcd-934f-4d9e-9bdc-98d3172d3ea6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.159981 Jan 11 04:01:42.635331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 326/638] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:42 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:43.650999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:43.651603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:43.659218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:43.659376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:43.660153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:43.660584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:43.791667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:43.799363 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-068f8c06-68c3-47f4-a664-0b2fbf32927e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.151890 Jan 11 04:01:43.799922 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 313/639] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:43 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:44.816579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:44.817146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:44.823361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:44.824306 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:44.825072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:44.825502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:44.952823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:44.960587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-670b1576-686d-4b27-af4b-147baf44aee1 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.148032 Jan 11 04:01:44.961155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 327/640] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:44 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:45.977596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:45.978226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:45.985084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:45.985536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:45.986349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:45.986783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:46.111967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:46.119598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6291622a-15de-4a0b-a9a2-363ef615b538 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.145661 Jan 11 04:01:46.120158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 314/641] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:45 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:47.135873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:47.136474 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:47.142681 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:47.143128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:47.143901 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:47.144332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:47.270910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:47.278604 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-facbb823-c81b-4505-a8f0-b5e596778b33 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.146356 Jan 11 04:01:47.279438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 328/642] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:47 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:48.295123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:48.295657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:48.301904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:48.302354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:48.303131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:48.303566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:48.429620 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:48.437716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1499bca5-18c5-4281-9154-8ccf8255ebbe tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.146405 Jan 11 04:01:48.438284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 315/643] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:48 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:49.454718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:49.455332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:49.461644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:49.462120 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:49.462897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:49.463332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:49.587608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:49.596127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e24b00d7-2dfb-4205-ac2b-118623a435a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.145050 Jan 11 04:01:49.596697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 329/644] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:49 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:50.612649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:50.613255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:50.619495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:50.619951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:50.620716 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:50.621153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:50.746849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:50.754507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0a59fe0f-adbf-4e45-9b22-2f9cc9da21a2 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.145600 Jan 11 04:01:50.755069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 316/645] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:50 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:51.771038 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:51.771651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:51.777936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:51.778384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:51.779414 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:51.779847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:51.907603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:51.915297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6c649fd0-1c8e-4f48-ad75-758f351391d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.147906 Jan 11 04:01:51.915863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 330/646] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:51 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:52.932447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:52.933563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:52.939860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:52.940308 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:52.941095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:52.941535 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:53.072791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:53.081056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f3fc53e8-5739-4b45-8cff-35cb9cbaee36 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1566 microversion: 2.1 time: 0.152421 Jan 11 04:01:53.081624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 317/647] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:52 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:54.097440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:54.098110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:54.104371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.104848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.105624 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.106157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.236907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:54.245036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bf90dd80-4946-41ee-9a30-536952dca04e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1546 microversion: 2.1 time: 0.151163 Jan 11 04:01:54.246335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 331/648] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:54 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:54.262067 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:54.262598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:54.269072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.269518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.270386 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.270785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.353336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] HTTP exception thrown: Cannot 'detach_volume' instance 376b0310-ef7d-4609-ba47-c79f9805555b while it is in vm_state rescued Jan 11 04:01:54.353336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Returning 409 to user: Cannot 'detach_volume' instance 376b0310-ef7d-4609-ba47-c79f9805555b while it is in vm_state rescued {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:01:54.353336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-501fc23b-273c-498d-8021-ba72ba618173 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments/cbd855af-ddac-4457-84cb-218b5ec1cc0a" status: 409 len: 152 microversion: 2.1 time: 0.093850 Jan 11 04:01:54.353336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 318/649] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:01:54 2022] DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments/cbd855af-ddac-4457-84cb-218b5ec1cc0a => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 11 04:01:54.360050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:01:54.360590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:54.366560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.367016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.367804 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.368248 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.438529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-20203053-9273-4fe4-89f9-d7a2a317f665 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action" status: 202 len: 0 microversion: 2.1 time: 0.081986 Jan 11 04:01:54.439409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 332/650] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:01:54 2022] POST /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:01:54.447497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:54.449108 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:54.455283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.455728 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.456534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:54.456970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:54.691997 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:54.700207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3dac03dc-dd75-4526-9097-034911faa989 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1554 microversion: 2.1 time: 0.256558 Jan 11 04:01:54.700775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 319/651] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:54 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:55.717115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:55.717872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:55.729277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:55.729277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:55.729277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:55.729277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:55.859860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:55.867838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1c4dd4b2-88f6-4c46-980f-f6b825be5872 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1554 microversion: 2.1 time: 0.155288 Jan 11 04:01:55.868406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 333/652] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:55 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:56.884496 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:56.885216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:56.893253 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:56.893976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:56.894551 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:56.894993 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:57.031068 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:57.038892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dd0c7a35-0bd4-42a9-8bcd-6d1f12e78e42 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1554 microversion: 2.1 time: 0.158083 Jan 11 04:01:57.039450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 320/653] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:56 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:58.055413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:58.056026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:58.062941 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.063389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.064175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.064608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.195864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:01:58.203717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-21edf1c7-65de-4a24-be2c-a06ec6245f68 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1560 microversion: 2.1 time: 0.151893 Jan 11 04:01:58.204412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 334/654] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:01:58 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:01:58.269956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:58.270470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:58.277198 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.277657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.278467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.278906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.358699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'services' on Instance uuid 376b0310-ef7d-4609-ba47-c79f9805555b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:01:58.429089 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2e1f2a79-2e39-4076-a038-328fb59c95b5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments/cbd855af-ddac-4457-84cb-218b5ec1cc0a" status: 202 len: 0 microversion: 2.1 time: 0.162615 Jan 11 04:01:58.429705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 321/655] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:01:58 2022] DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments/cbd855af-ddac-4457-84cb-218b5ec1cc0a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:01:58.440799 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:58.441842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:58.449027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.449982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.451023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:58.451464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:58.486970 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-481db917-e24b-4a76-810e-eb6c8921f374 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052972 Jan 11 04:01:58.490824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 335/656] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:01:58 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:01:59.500373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:01:59.502017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:01:59.512872 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:59.514848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:59.515880 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:01:59.516331 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:01:59.551569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-05130ff9-bcf6-4d67-9503-d7bff425e608 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056661 Jan 11 04:01:59.552363 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 322/657] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:01:59 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:02:01.858760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:01.859242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:01.865409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:01.866083 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:01.866917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:01.867352 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:01.895600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:02:01.970125 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d14cbc43-6e27-40b8-95cb-d440d51fdfdb tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "DELETE /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 204 len: 0 microversion: 2.1 time: 0.114489 Jan 11 04:02:01.970822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 336/658] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:02:01 2022] DELETE /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:02:01.979194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:01.979917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:01.986491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:01.987071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:01.987967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:01.988525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:02.135099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:02.142812 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-810b71a3-608e-4e42-8aba-23669fec9da8 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.167519 Jan 11 04:02:02.143372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 323/659] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:01 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:03.160182 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:03.160929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:03.167216 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:03.167670 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:03.168453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:03.169132 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:03.314357 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:03.321819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-386a5b13-0c72-4dfc-91d4-3733c02eb26e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.165561 Jan 11 04:02:03.322382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 337/660] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:03 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:04.339464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:04.340075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:04.346298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:04.346746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:04.347525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:04.347961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:04.700554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:04.707778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-50c2c02c-e39f-4534-aa75-f2a291511c54 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.371903 Jan 11 04:02:04.708338 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 324/661] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:04 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:05.724546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:05.725144 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:05.731642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:05.732087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:05.732856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:05.733287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:05.857403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:05.864564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-855925b4-bae8-4061-bbb9-40274aee5346 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.143667 Jan 11 04:02:05.865133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 338/662] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:05 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:06.880633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:06.881271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:06.887749 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:06.888190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:06.888954 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:06.889595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:07.017594 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:07.024847 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-aae3d9ba-d07b-4507-8af3-09eb62d1ee72 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.147822 Jan 11 04:02:07.025619 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 325/663] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:06 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:08.041787 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:08.042410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:08.048827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:08.049281 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:08.050088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:08.050530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:08.174985 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:08.182186 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1ae5fac5-97eb-48af-a695-ee7bf4717104 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1508 microversion: 2.1 time: 0.144226 Jan 11 04:02:08.182822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 339/664] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:08 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:08.855131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-dbd1dd1b-572d-4a28-8706-380b05a97ebe req-3a720e6b-db14-4334-ab91-d4629782ba13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84501321-d633-43bb-9f6c-8802aefa5bd6", "name": "network-vif-deleted", "tag": "2364fafc-197f-40d7-997d-ccc1075bbf00"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:08.856702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:02:08.856702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:02:08.864101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-dbd1dd1b-572d-4a28-8706-380b05a97ebe req-3a720e6b-db14-4334-ab91-d4629782ba13 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:08.864540 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-dbd1dd1b-572d-4a28-8706-380b05a97ebe req-3a720e6b-db14-4334-ab91-d4629782ba13 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:08.875821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-dbd1dd1b-572d-4a28-8706-380b05a97ebe req-3a720e6b-db14-4334-ab91-d4629782ba13 service nova] Creating event network-vif-deleted:2364fafc-197f-40d7-997d-ccc1075bbf00 for instance 84501321-d633-43bb-9f6c-8802aefa5bd6 on hv-cinder-81977 Jan 11 04:02:08.880974 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-dbd1dd1b-572d-4a28-8706-380b05a97ebe req-3a720e6b-db14-4334-ab91-d4629782ba13 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029345 Jan 11 04:02:08.881642 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 326/665] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:02:09.198284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:09.198900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:09.205728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:09.206181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:09.206960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:09.207398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:09.237372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:09.237858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:09.238305 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:09.276431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:09.283855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b9dc6c19-5fd3-43e8-904b-dc80fe8ba583 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1312 microversion: 2.1 time: 0.089188 Jan 11 04:02:09.284415 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 340/666] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:09 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:10.300859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:10.301503 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:10.307991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:10.308442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:10.309812 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:10.310254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:10.340134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:10.340581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:10.341027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:10.379751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:10.386853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0a200c10-0687-4c79-81d8-62ff9c61b7d5 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1312 microversion: 2.1 time: 0.090136 Jan 11 04:02:10.387418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 327/667] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:10 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:11.403615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:11.404478 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:11.410696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:11.411147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:11.411930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:11.412363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:11.442692 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:11.443133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:11.443576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:11.480919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:11.488283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0c294011-0af5-4060-b23b-9ad3f26846d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1312 microversion: 2.1 time: 0.088885 Jan 11 04:02:11.488838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 341/668] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:11 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:12.507712 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:12.508336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:12.514597 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:12.515048 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:12.515829 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:12.516270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:12.546339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:12.546805 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:12.547252 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:12.584012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:12.591846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8cd04165-0e00-4ffd-b4af-0c849311c8b6 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1312 microversion: 2.1 time: 0.089411 Jan 11 04:02:12.592404 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 328/669] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:12 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1312 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:13.358607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:13.359598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:13.366118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.366577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.367397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.367836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.436439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9a6fbb3e-6ffe-4d3f-81d0-7937dd57d244 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action" status: 202 len: 0 microversion: 2.1 time: 0.081388 Jan 11 04:02:13.440231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 342/670] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:02:13 2022] POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:02:13.445798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:13.446405 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:13.452779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.453257 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.454103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.454558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.599468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:13.607214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7ac58457-7a8e-41c7-8e4d-ed65578039a6 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1754 microversion: 2.1 time: 0.165531 Jan 11 04:02:13.607949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 329/671] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:13 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:13.608586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:13.609336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:13.615174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.615620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.616391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.616822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.646283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:13.646725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:13.647164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 84501321-d633-43bb-9f6c-8802aefa5bd6 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:13.685590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:13.693385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d4ba8b0e-952e-4438-b04f-a987c5691f4d tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 200 len: 1312 microversion: 2.1 time: 0.088836 Jan 11 04:02:13.694056 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 343/672] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:13 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:14.624844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:14.625480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:14.631964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.632413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.633218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.633654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.710720 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:14.711113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 84501321-d633-43bb-9f6c-8802aefa5bd6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:14.718081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.718544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.719369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.719979 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.734322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] HTTP exception thrown: Instance 84501321-d633-43bb-9f6c-8802aefa5bd6 could not be found. Jan 11 04:02:14.734915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Returning 404 to user: Instance 84501321-d633-43bb-9f6c-8802aefa5bd6 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:02:14.735724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-798692c6-8926-44df-bb2d-3e4347a47f18 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6" status: 404 len: 111 microversion: 2.1 time: 0.029161 Jan 11 04:02:14.736641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 344/673] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:14 2022] GET /compute/v2.1/servers/84501321-d633-43bb-9f6c-8802aefa5bd6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 04:02:14.743918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:14.744417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:14.750354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.750801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.751595 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.752067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.778541 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:02:14.784012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:14.793012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-79d664f2-f203-4e8e-957e-3fe0cc092562 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.171854 Jan 11 04:02:14.793966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 330/674] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:14 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:14.860752 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1a1f3224-e67e-4000-9d2c-f2514a592471 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 204 len: 0 microversion: 2.1 time: 0.119590 Jan 11 04:02:14.861330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 345/675] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:02:14 2022] DELETE /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 04:02:14.868915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:14.869522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:14.875406 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.875794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:14.876561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:14.876995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:15.006587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:15.013877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0c9f3aa9-b06b-4a30-b8f5-3de7bb6467fa tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.148504 Jan 11 04:02:15.014958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 331/676] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:14 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:15.811237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:15.812448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:15.818649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:15.819099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:15.819880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:15.820327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:15.962715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:15.971026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4a000d11-b2a1-4148-a37e-dc7845ea77ad tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.163977 Jan 11 04:02:15.971589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 346/677] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:15 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:16.031610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:16.032235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:16.038543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:16.038992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:16.039773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:16.040209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:16.176473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:16.184625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-49ec8744-8641-4038-8853-b59fb5759f3a tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.157392 Jan 11 04:02:16.185206 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 332/678] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:16 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:16.987459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:16.988072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:16.994389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:16.994742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:16.995518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:16.995957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:17.139858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:17.147598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8b6ac56d-4a71-457f-bf89-4fa265f3ba88 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.164337 Jan 11 04:02:17.148158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 347/679] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:16 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:17.201482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:17.202557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:17.208793 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:17.209246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:17.210057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:17.210502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:17.341160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:17.348915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8fd3a01d-3ac2-4527-98f7-a4b51fe5b013 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.151195 Jan 11 04:02:17.349651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 333/680] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:17 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:18.164946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:18.165554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:18.172585 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:18.172975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:18.173773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:18.174210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:18.314202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:18.321841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e82c553b-cc60-4161-8fc0-9f6ed476cd7f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.160510 Jan 11 04:02:18.322401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 348/681] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:18 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:18.365043 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:18.365643 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:18.371889 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:18.372315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:18.373080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:18.373509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:18.499489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:18.507303 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7dca4ee1-ccf3-4b41-95ef-9225ea2b7adc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.145649 Jan 11 04:02:18.507914 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 334/682] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:18 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:19.338231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:19.338842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:19.345696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:19.346155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:19.346931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:19.347372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:19.488223 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:19.495877 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-89c50411-21d6-4630-a424-9def576ed9a1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.161283 Jan 11 04:02:19.496435 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 349/683] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:19 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:19.524426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:19.525040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:19.531835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:19.532277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:19.533047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:19.533474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:19.658368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:19.665537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ef4168d0-076e-48fa-8678-ac2e6768651e tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.145049 Jan 11 04:02:19.666116 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 335/684] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:19 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:20.512828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:20.513444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:20.520323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:20.520772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:20.521544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:20.522003 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:20.660545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:20.668156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b5862e49-0b86-44f4-b484-a4a204ff45b1 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.158932 Jan 11 04:02:20.668713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 350/685] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:20 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:20.682218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:20.682831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:20.689486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:20.689972 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:20.690750 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:20.691188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:20.821047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:20.828293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bee25733-23c9-4f64-94bb-fc055ada39bc tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.149634 Jan 11 04:02:20.828857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 336/686] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:20 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:21.684762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:21.685385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:21.691893 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:21.692412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:21.693276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:21.693728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:21.841352 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:21.844696 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:21.845900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:21.849757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f15685bc-5f2b-42cc-a8df-d29141322a0b tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.168539 Jan 11 04:02:21.850330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 351/687] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:21 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:21.853450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:21.853936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:21.854740 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:21.855175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:22.163142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:22.171114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-393c88aa-8ea6-46ae-bb6c-746862d34cc0 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1520 microversion: 2.1 time: 0.330070 Jan 11 04:02:22.171691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 337/688] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:21 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:22.699649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-42f1e06d-adb1-42de-9619-931725c20c3f req-d89e3e6e-bc93-47ae-b185-0ce41c1a8e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376b0310-ef7d-4609-ba47-c79f9805555b", "name": "network-vif-deleted", "tag": "6aa178e1-0846-40fa-8f5f-6f757faea583"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:22.701155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:02:22.701155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:02:22.709046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-42f1e06d-adb1-42de-9619-931725c20c3f req-d89e3e6e-bc93-47ae-b185-0ce41c1a8e75 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:22.709494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-42f1e06d-adb1-42de-9619-931725c20c3f req-d89e3e6e-bc93-47ae-b185-0ce41c1a8e75 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:22.720489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-42f1e06d-adb1-42de-9619-931725c20c3f req-d89e3e6e-bc93-47ae-b185-0ce41c1a8e75 service nova] Creating event network-vif-deleted:6aa178e1-0846-40fa-8f5f-6f757faea583 for instance 376b0310-ef7d-4609-ba47-c79f9805555b on hv-cinder-81977 Jan 11 04:02:22.725360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-42f1e06d-adb1-42de-9619-931725c20c3f req-d89e3e6e-bc93-47ae-b185-0ce41c1a8e75 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029274 Jan 11 04:02:22.725981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 352/689] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:02:22.867932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:22.868454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:22.875987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:22.876543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:22.878121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:22.878652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:23.062931 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:23.070936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-697937a4-0a73-426c-9060-55cf0da31c0c tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.206685 Jan 11 04:02:23.071510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 338/690] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:22 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:23.188233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:23.188957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:23.195080 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:23.195526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:23.196302 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:23.196740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:23.227286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:23.227733 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:23.228176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lazy-loading 'fault' on Instance uuid 376b0310-ef7d-4609-ba47-c79f9805555b {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:23.319868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299933ca0f6c45a38b9099a4a175abb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b52b56248e6442f9eba0935d808ccd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:23.326483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cd41cf79-a690-4c65-8218-8b7b723784d4 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 200 len: 1310 microversion: 2.1 time: 0.142697 Jan 11 04:02:23.327058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 353/691] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:23 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 1310 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:24.087216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:24.087826 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:24.094735 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:24.095181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:24.095961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:24.096397 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:24.243431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:24.254275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a026adfc-c1c4-4d26-af18-57d85fac927d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.170657 Jan 11 04:02:24.255021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 339/692] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:24 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:24.343172 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:24.343779 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] [instance: 376b0310-ef7d-4609-ba47-c79f9805555b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:24.350081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:24.350533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:24.351309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:24.351743 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:24.364717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] HTTP exception thrown: Instance 376b0310-ef7d-4609-ba47-c79f9805555b could not be found. Jan 11 04:02:24.365296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] Returning 404 to user: Instance 376b0310-ef7d-4609-ba47-c79f9805555b could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:02:24.366132 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bd695259-9ba4-4be0-8f3b-d1f5e44d1d78 tempest-ServerRescueNegativeTestJSON-619173893 tempest-ServerRescueNegativeTestJSON-619173893-project] 10.222.0.24 "GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b" status: 404 len: 111 microversion: 2.1 time: 0.026659 Jan 11 04:02:24.366662 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 354/693] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:24 2022] GET /compute/v2.1/servers/376b0310-ef7d-4609-ba47-c79f9805555b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:02:25.273244 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:25.273872 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:25.281407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:25.282066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:25.282851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:25.283444 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:25.448110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:25.456184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9c294714-67fc-4cd8-a84a-00b12d873598 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.188670 Jan 11 04:02:25.457013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 340/694] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:25 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:25.652587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:02:25.652587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:02:26.477332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:26.478170 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:26.484729 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:26.485411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:26.486234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:26.486651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:26.764195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:26.772823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-221b08eb-7a3c-4aca-a69f-5bd3f2cce592 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.303048 Jan 11 04:02:26.773456 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 355/695] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:26 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:27.789995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:27.790605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:27.797225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:27.797713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:27.798495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:27.798939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:27.947917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:27.956098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dd1bf9c7-d8b0-483e-87b6-6ddbbd23bf36 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.169709 Jan 11 04:02:27.956667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 341/696] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:27 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:28.973646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:28.974285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:28.981447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:28.982069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:28.983301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:28.983857 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:29.129383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:29.137595 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b1b8d264-8857-47fd-a2c6-7ac1ead33a94 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.167505 Jan 11 04:02:29.138264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 356/697] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:28 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:30.156313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:30.156936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:30.163515 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:30.164153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:30.165197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:30.165643 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:30.310928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:30.318915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7d997317-84f2-4d9c-9f80-a10b24f15549 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1759 microversion: 2.1 time: 0.167073 Jan 11 04:02:30.319497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 342/698] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:30 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:31.336735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:31.337538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:31.345981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:31.346579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:31.347510 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:31.348051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:31.494827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:31.504384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ce5a4153-ab2c-4fe6-a14e-aa53b60d21c0 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1762 microversion: 2.1 time: 0.171428 Jan 11 04:02:31.518431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 357/699] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:31 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1762 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:32.869117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: .version_select at 0x7f4e659741f0>, body: {"keypair": {"name": "tempest-keypair-471692725"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:32.885104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:02:32.888934 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:02:32.901171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [428217f1-3596-4a66-8d3e-173b1b5326b1] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 04:02:33.909798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [428217f1-3596-4a66-8d3e-173b1b5326b1] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 33448. Jan 11 04:02:34.011885 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:02:34.016346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:02:34.030049 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-22cfff3d-968f-4967-abfe-d522ba7decb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.275444 Jan 11 04:02:34.030700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 343/700] 10.222.0.24 () {62 vars in 1198 bytes} [Tue Jan 11 04:02:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1278 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 04:02:35.274937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-890570542", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fb11a25-fb24-411b-9039-109a92324917"}], "security_groups": [{"name": "tempest-securitygroup--321883411"}], "key_name": "tempest-keypair-471692725", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:35.383215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] validate_networks() for [('2fb11a25-fb24-411b-9039-109a92324917', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:02:35.868983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:02:35.870086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:02:35.871224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:02:35.871871 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:02:35.872921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:02:35.883369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:35.884288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:35.885205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:35.885939 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:35.909350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:02:35.918724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:02:35.930527 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:02:35.932972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:02:35.985807 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-daeff0ec-38c1-4a04-9a1e-73803fb67725 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.714782 Jan 11 04:02:35.987000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 358/701] 10.222.0.24 () {62 vars in 1187 bytes} [Tue Jan 11 04:02:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 11 04:02:35.997146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:35.997786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:36.071140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:36.082594 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:36.084456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:36.085767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-22700801-526a-4191-962d-baeb09c041b8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1280 microversion: 2.20 time: 0.092873 Jan 11 04:02:36.097712 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 344/702] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:35 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:37.104759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:37.105323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:37.112453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:37.112899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:37.113698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:37.114137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:37.172002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:37.179695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:37.181196 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:37.182333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-80849e2e-92af-4d5e-aa77-8acc75250b4e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1284 microversion: 2.20 time: 0.082039 Jan 11 04:02:37.182889 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 359/703] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:37 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:38.199012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:38.199637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:38.206707 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:38.207180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:38.208017 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:38.208446 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:38.271588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:38.280723 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:38.282406 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:38.283606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-14db8dea-0fab-43bd-865f-2eeb14d4bbc0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1340 microversion: 2.20 time: 0.088368 Jan 11 04:02:38.284645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 345/704] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:38 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:39.302482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:39.303239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:39.309971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:39.310419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:39.311382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:39.312067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:39.574085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:39.586775 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:39.588525 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:39.589997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f3dc6e9b-e6b2-4ae9-ae89-46fe5f1d6879 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.291348 Jan 11 04:02:39.591160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 360/705] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:39 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:39.750680 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-c5d78918-66a8-4d2e-87f7-1a703815c998 req-1b451708-1259-401c-b7f9-93cb20f0839f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:39.753740 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:02:39.753740 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:02:39.763430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-c5d78918-66a8-4d2e-87f7-1a703815c998 req-1b451708-1259-401c-b7f9-93cb20f0839f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:39.763880 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-c5d78918-66a8-4d2e-87f7-1a703815c998 req-1b451708-1259-401c-b7f9-93cb20f0839f service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:39.783473 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-c5d78918-66a8-4d2e-87f7-1a703815c998 req-1b451708-1259-401c-b7f9-93cb20f0839f service nova] Creating event network-changed:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:02:39.788733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-c5d78918-66a8-4d2e-87f7-1a703815c998 req-1b451708-1259-401c-b7f9-93cb20f0839f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044344 Jan 11 04:02:39.789879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 346/706] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:02:40.610754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:40.611882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:40.618467 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:40.618913 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:40.619702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:40.620134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:40.833322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:40.841579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:40.843129 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:40.844742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b32eedf9-2d65-4890-b20a-df0d675af354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.237791 Jan 11 04:02:40.845304 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 361/707] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:40 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:41.133032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:41.133634 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:41.139907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:41.140357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:41.141753 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:41.142194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:41.221368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lazy-loading 'services' on Instance uuid 36cfea01-d609-4829-8083-058ca877eab5 {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:02:41.286977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-488998b8-48fa-4c6b-87e6-cd4225236869 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments/583d2988-9335-4793-914e-8fba2e0f4fbd" status: 202 len: 0 microversion: 2.1 time: 0.266920 Jan 11 04:02:41.287498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 347/708] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:02:41 2022] DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments/583d2988-9335-4793-914e-8fba2e0f4fbd => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:02:41.864552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:41.865442 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:41.878926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:41.879383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:41.880210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:41.880735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:42.028406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:42.038328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:42.040041 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:42.041153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2260b50d-b13e-4849-90fe-fdcd49d4d9d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.181455 Jan 11 04:02:42.041801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 362/709] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:41 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:42.405528 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d12c2092-0f98-416e-a016-c980d86b57ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:42.412151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d12c2092-0f98-416e-a016-c980d86b57ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:42.412599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d12c2092-0f98-416e-a016-c980d86b57ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:42.435911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d12c2092-0f98-416e-a016-c980d86b57ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Going to try to stop instance {{(pid=116387) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 11 04:02:42.477482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d12c2092-0f98-416e-a016-c980d86b57ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 202 len: 0 microversion: 2.1 time: 0.076581 Jan 11 04:02:42.478119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 348/710] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:02:42 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:02:42.486942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:42.487553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:42.493445 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:42.493912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:42.494723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:42.495205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:42.626688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:42.634096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-05c6cbcd-38fa-4c4a-ad80-f1095e3a76d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.151168 Jan 11 04:02:42.634683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 363/711] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:42 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:43.058840 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:43.060013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:43.067514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:43.068255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:43.069463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:43.069954 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:43.221531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:43.229730 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:43.231641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:43.232951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2c1eb490-41ec-409c-a3c9-1d088ef5cef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.178235 Jan 11 04:02:43.233740 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 349/712] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:43 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:43.652158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:43.652805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:43.659508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:43.659918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:43.660718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:43.661156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:43.807817 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:43.815246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-198d8b06-0c03-49dd-a13a-66520f39b4f8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.166639 Jan 11 04:02:43.815826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 364/713] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:43 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:44.250526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:44.251137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:44.257453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:44.257933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:44.258752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:44.259183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:44.389190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:44.397584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:44.399145 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:44.400246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-32954fa0-e4cd-4100-a84b-bf1ed5edd2ee tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.153501 Jan 11 04:02:44.400815 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 350/714] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:44 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:44.833828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:44.834607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:44.841328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:44.841811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:44.842602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:44.843044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:44.977475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:44.985277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fec6a366-783d-4bd4-8321-2a57d1e49c34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.155882 Jan 11 04:02:44.985861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 365/715] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:44 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:45.418019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:45.418631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:45.425487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:45.426108 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:45.426901 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:45.427351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:45.564031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:45.573459 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:45.575012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:45.576124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-793366e7-daa0-4753-bc6e-7d6a625acfe1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.161812 Jan 11 04:02:45.576686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 351/716] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:45 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:45.892755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-8e92624f-06de-4326-a4b4-99c978cb9b74 req-79e8b89b-78ac-4a5c-a3b7-14ece9d62942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "name": "network-vif-plugged", "status": "completed", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:45.895137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:02:45.895137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:02:45.907347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-8e92624f-06de-4326-a4b4-99c978cb9b74 req-79e8b89b-78ac-4a5c-a3b7-14ece9d62942 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:45.907786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-8e92624f-06de-4326-a4b4-99c978cb9b74 req-79e8b89b-78ac-4a5c-a3b7-14ece9d62942 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:45.920704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-8e92624f-06de-4326-a4b4-99c978cb9b74 req-79e8b89b-78ac-4a5c-a3b7-14ece9d62942 service nova] Creating event network-vif-plugged:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:02:45.926068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-8e92624f-06de-4326-a4b4-99c978cb9b74 req-79e8b89b-78ac-4a5c-a3b7-14ece9d62942 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 Jan 11 04:02:45.926900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 366/717] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:02:46.003504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:46.004134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:46.010283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:46.010736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:46.011538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:46.011973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:46.151160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:46.159910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6e81b395-9eb1-45fd-a053-2a5f9fc3fd91 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.161264 Jan 11 04:02:46.160488 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 352/718] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:45 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:46.595783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:46.596592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:46.604945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:46.605322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:46.606119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:46.606549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:46.742428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:46.750550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:46.752047 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:46.753142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f4e677cd-20d2-43a9-a3a5-2b201034a512 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.161463 Jan 11 04:02:46.753806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 367/719] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:46 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:47.177474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:47.178072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:47.184251 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:47.184704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:47.185479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:47.185946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:47.322596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:47.329830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d896fbe9-a8db-4018-a805-386c73767d34 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.156084 Jan 11 04:02:47.330399 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 353/720] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:47 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:47.771119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:47.771658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:47.778087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:47.778541 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:47.779584 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:47.780023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:47.911042 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:47.925229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:47.926756 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:47.927971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8b1acd78-9eff-4b16-87b5-df445f21f5a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1405 microversion: 2.20 time: 0.160600 Jan 11 04:02:47.928692 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 368/721] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:47 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:48.346770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:48.347372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:48.353758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:48.354218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:48.355016 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:48.355453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:48.481348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:48.489200 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a09fc055-dcbb-4149-b44a-98012354f732 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.146069 Jan 11 04:02:48.489792 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 354/722] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:48 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:48.945251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:48.945894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:48.952208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:48.952657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:48.953437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:48.953899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:49.082730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:49.090501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:49.092014 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:49.093161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-91f32153-e957-4cd2-98de-66d56474aac1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1597 microversion: 2.20 time: 0.151665 Jan 11 04:02:49.094275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 369/723] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:02:48 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1597 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:02:49.114362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:49.115031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:49.121739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:49.122173 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:49.122964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:49.123395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:49.200589 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-04feb1d6-c7a3-4223-a996-b159be1c26c1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090085 Jan 11 04:02:49.201178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 355/724] 10.222.0.24 () {60 vars in 1315 bytes} [Tue Jan 11 04:02:49 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:02:49.507233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:49.507760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:49.513606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:49.514098 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:49.514890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:49.515363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:49.654573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:49.663903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-27b04789-99af-4271-8ca3-ad00e65dbe71 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.161039 Jan 11 04:02:49.664479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 370/725] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:49 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:50.128989 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:50.130056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:50.138786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:50.139251 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:50.140069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:50.141019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:50.198105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-39935c43-1bfe-4ed8-ab06-4539ea23e2cd req-a2984f38-5539-4dde-8c52-c76271be15bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:50.199695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:02:50.199695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:02:50.207334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-39935c43-1bfe-4ed8-ab06-4539ea23e2cd req-a2984f38-5539-4dde-8c52-c76271be15bf service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:50.207774 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-39935c43-1bfe-4ed8-ab06-4539ea23e2cd req-a2984f38-5539-4dde-8c52-c76271be15bf service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:50.219980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-39935c43-1bfe-4ed8-ab06-4539ea23e2cd req-a2984f38-5539-4dde-8c52-c76271be15bf service nova] Creating event network-changed:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:02:50.225076 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-39935c43-1bfe-4ed8-ab06-4539ea23e2cd req-a2984f38-5539-4dde-8c52-c76271be15bf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103273 Jan 11 04:02:50.225733 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 371/726] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:02:50.232615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d8c7a7c0-8055-481e-96de-867ecc72b07c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.112816 Jan 11 04:02:50.236034 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 356/727] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:50 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:50.681887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:50.682596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:50.689273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:50.689766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:50.690808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:50.691257 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:50.862058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:50.869592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-04838b63-50bc-4da8-bbe6-548c3d385dc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.191718 Jan 11 04:02:50.870201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 372/728] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:50 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:51.244378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:51.245435 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:51.252833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:51.253283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:51.254122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:51.254563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:51.346586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8d388b21-8581-4896-8fe0-7b58f196249d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.106253 Jan 11 04:02:51.349851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 357/729] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:51 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:51.886117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:51.886757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:51.893633 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:51.894106 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:51.894890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:51.895330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:52.025070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:52.033189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3b5bdb07-3afb-4666-8454-1616bf376be0 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.150687 Jan 11 04:02:52.033949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 373/730] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:51 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:52.358037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:52.359146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:52.367101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:52.367553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:52.368346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:52.368785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:52.473902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4f7e2d53-373b-486f-af1a-533dda1133bf tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.119728 Jan 11 04:02:52.474621 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 358/731] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:52 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:53.050937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:53.051509 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:53.057939 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:53.058396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:53.059219 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:53.059661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:53.426782 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:53.434355 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5fe90d5c-0fd8-4497-b433-af2f0039b5bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.388189 Jan 11 04:02:53.435138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 374/732] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:53 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:53.485633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:53.486682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:53.494108 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:53.494553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:53.495351 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:53.495809 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:53.589471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-04e92720-f085-4fd7-9ba1-19a6244ae668 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.108242 Jan 11 04:02:53.590129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 359/733] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:53 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:54.451009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:54.451625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:54.457838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:54.458290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:54.459066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:54.459500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:54.583418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:54.590661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eacce201-1cba-4853-84e4-07fd9e284063 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.143240 Jan 11 04:02:54.591223 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 375/734] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:54 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:54.600588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:54.601593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:54.608393 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:54.608850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:54.609635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:54.610626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:54.709859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-420b5f94-76fa-43d6-979b-a0633f84ad0e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.113060 Jan 11 04:02:54.710413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 360/735] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:54 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:55.607606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:55.608308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:55.615157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:55.615606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:55.616388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:55.616856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:55.721563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:55.722746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:55.729842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:55.730289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:55.731166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:55.731602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:55.744505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:55.751904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-259c6415-d4e2-427d-9da3-5122c3c4ffd1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.148101 Jan 11 04:02:55.752507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 376/736] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:55 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:55.841762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8576502b-b912-416c-be0e-146d77499100 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.124493 Jan 11 04:02:55.842321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 361/737] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:55 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:56.768623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:56.769233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:56.775534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:56.775984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:56.776766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:56.777204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:56.853382 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:56.854510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:56.861563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:56.862044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:56.862827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:56.863294 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:56.913243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:56.920687 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-57202bdb-642e-4b32-adc6-425cffc9532d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.156238 Jan 11 04:02:56.921270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 377/738] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:56 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:56.958967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d2bd4965-3613-4818-8877-e70cc3c9871d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.109420 Jan 11 04:02:56.959629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 362/739] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:56 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:02:57.937348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:57.937999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:57.944739 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:57.944739 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:57.945482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:57.945954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:57.970779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:57.971771 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:57.978901 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:57.979346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:57.980130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:57.980564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:58.068010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9b8fe336-6361-4d63-a13d-ff7fa3b16d3f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.101542 Jan 11 04:02:58.071154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 363/740] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:57 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:58.073221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:58.080818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-02670cb1-ff8f-44e7-914f-fc30123b40d4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.147018 Jan 11 04:02:58.081423 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 378/741] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:57 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:59.079201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:02:59.080202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:59.087049 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:59.087507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:59.088314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:59.088758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:59.097935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:02:59.098556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:02:59.105099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:59.105554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:59.106367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:02:59.106813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:02:59.179709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-17ab54f7-8232-45e3-abcf-622430a610fd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.104123 Jan 11 04:02:59.182756 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 364/742] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:02:59 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:02:59.236212 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:02:59.243529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-80ca2f0c-d0e9-49b6-90de-3368186a6d5d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.149265 Jan 11 04:02:59.244200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 379/743] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:02:59 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:03:00.191430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:00.192355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:00.199193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:00.199644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:00.200421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:00.200857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:00.260640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:00.261325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:00.268446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:00.268890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:00.269665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:00.270176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:00.290615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9ccb6629-e4da-4a8f-a041-eaa7ae0bb4ac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.103594 Jan 11 04:03:00.291506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 365/744] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:00 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:00.398189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:00.405630 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63fec371-47b2-426a-a0db-1210d7151681 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.148546 Jan 11 04:03:00.406221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 380/745] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:00 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:03:01.302690 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:01.303691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:01.310510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:01.310963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:01.311743 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:01.312175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:01.400866 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-953b7538-ecf4-44fe-887b-3e1d143d87d6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.102152 Jan 11 04:03:01.401556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 366/746] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:01 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:01.422935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:01.423553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:01.429878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:01.430327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:01.431133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:01.431573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:01.561713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:01.568828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-07fd1483-093c-4914-892a-a45e88dd0851 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.150205 Jan 11 04:03:01.569386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 381/747] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:01 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:02.411969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:02.412966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:02.419857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:02.420305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:02.421085 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:02.421521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:02.515076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-080154fc-46b9-4c9a-a1fe-47e60d877f31 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 14 microversion: 2.20 time: 0.107028 Jan 11 04:03:02.515692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 367/748] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:02 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:02.590214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:02.590855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:02.597158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:02.597612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:02.598447 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:02.598891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:02.724128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:02.731420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4f13eda1-fac6-4428-9455-c49065b26558 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1675 microversion: 2.1 time: 0.144825 Jan 11 04:03:02.732062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 382/749] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:02 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:03.526924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:03.527849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:03.535635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.536090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.536870 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.537309 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.655490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ec142446-1f0f-4fad-9d09-d4008191f90b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 10744 microversion: 2.20 time: 0.132536 Jan 11 04:03:03.656118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 368/750] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:03 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 10744 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:03.747864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:03.748480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:03.754795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.755252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.756034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.756505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.882791 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:03.889917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-661d47c3-681e-440d-9b1e-c8b959a68800 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1652 microversion: 2.1 time: 0.145626 Jan 11 04:03:03.890477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 383/751] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:03 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:03.907216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fe576a5e-db87-471a-8acc-bf8c6fc15074 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:03.914101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fe576a5e-db87-471a-8acc-bf8c6fc15074 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.914554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fe576a5e-db87-471a-8acc-bf8c6fc15074 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.938504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fe576a5e-db87-471a-8acc-bf8c6fc15074 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Going to try to start instance {{(pid=116387) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 11 04:03:03.976877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fe576a5e-db87-471a-8acc-bf8c6fc15074 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action" status: 202 len: 0 microversion: 2.1 time: 0.073815 Jan 11 04:03:03.977470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 369/752] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:03:03 2022] POST /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:03.985167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:03.985817 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:03.991544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.991997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:03.992784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:03.993221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:04.149082 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:04.157129 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3d47c6bf-6924-42f8-af04-6f58f004882b tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1661 microversion: 2.1 time: 0.175452 Jan 11 04:03:04.157753 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 384/753] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:03 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1661 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:04.668201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:04.669142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:04.675709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:04.676158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:04.677098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:04.677542 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:04.769550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-31963e46-846d-41b0-b131-3034b7642354 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 17092 microversion: 2.20 time: 0.105762 Jan 11 04:03:04.770217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 370/754] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:04 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 17092 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:05.173648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:05.174229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:05.180492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:05.180940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:05.181747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:05.182187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:05.315480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:05.322767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-baf0df31-47f1-4ac6-b667-77ce059109bb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1661 microversion: 2.1 time: 0.152828 Jan 11 04:03:05.323316 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 385/755] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:05 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:05.781133 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:05.782158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:05.788845 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:05.789291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:05.790080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:05.790511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:05.899168 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-42907849-de3b-4964-8cde-15a6d0674300 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 17931 microversion: 2.20 time: 0.122180 Jan 11 04:03:05.899831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 371/756] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:05 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 17931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:06.339921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:06.340528 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:06.347081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:06.347526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:06.348297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:06.348728 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:06.478065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:06.486286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-548ce31b-c17c-4a4e-a8cc-68cbab1a4180 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1665 microversion: 2.1 time: 0.149891 Jan 11 04:03:06.486732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 386/757] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:06 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:06.910554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:06.911517 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:06.918843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:06.919372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:06.920322 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:06.920678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:07.010912 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9dee09c1-46c9-497b-ae52-4f8f17ced1fb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 19661 microversion: 2.20 time: 0.104429 Jan 11 04:03:07.011524 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 372/758] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:06 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 19661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:08.022468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:08.023403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:08.030032 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:08.030477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:08.031247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:08.031729 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:08.142848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-887eda5d-2154-4806-951c-5c8a82eabd3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 22494 microversion: 2.20 time: 0.123941 Jan 11 04:03:08.143482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 387/759] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:08 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 22494 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:09.155075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:09.156101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:09.163452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:09.163897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:09.164669 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:09.165124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:09.258102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0fd10846-ebc6-457b-8db8-de13e37a8fbe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 23804 microversion: 2.20 time: 0.107044 Jan 11 04:03:09.258637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 373/760] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:09 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 23804 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:10.269393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:10.270414 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:10.277247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:10.277716 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:10.278494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:10.278930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:10.381486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-19323aa6-3a9e-406f-b383-ee7daec00bba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 25147 microversion: 2.20 time: 0.115909 Jan 11 04:03:10.383607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 388/761] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:10 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 25147 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:11.393440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:11.394575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:11.404708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:11.405166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:11.406005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:11.406442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:11.512431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-39e99f98-6841-4ecb-9eae-dd39dee15137 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 26601 microversion: 2.20 time: 0.123510 Jan 11 04:03:11.513301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 374/762] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:11 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 26601 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:12.524972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:12.526062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:12.534454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:12.534932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:12.535723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:12.536160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:12.630758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-10328d27-07ef-4486-8c8e-1d0e430c2a27 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 27394 microversion: 2.20 time: 0.109768 Jan 11 04:03:12.633794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 389/763] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:12 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 27394 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:13.643303 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:13.644255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:13.651059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:13.651505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:13.652290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:13.652732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:13.756782 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-72031da8-965a-4723-950e-53eef6160a93 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 27822 microversion: 2.20 time: 0.117534 Jan 11 04:03:13.757403 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 375/764] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:13 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 27822 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:14.544181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-794872626", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "41d337ad-d737-48f9-8bd1-0a792d30dc86"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:14.593454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] validate_networks() for [('41d337ad-d737-48f9-8bd1-0a792d30dc86', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:03:14.768966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:14.769992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:14.776635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:14.777079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:14.777877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:14.778310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:14.875837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e77a5374-cfc1-4416-be7f-c7fc32eeede9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28067 microversion: 2.20 time: 0.111171 Jan 11 04:03:14.879695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 376/765] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:14 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28067 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:14.924862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:03:14.925408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:03:14.925917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:03:14.926326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:03:14.926760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:03:14.935980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:14.936432 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:14.937287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:14.937757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:14.953372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Getting quotas for project 66bd43d3da6249f69f1a238934aae277. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:03:14.957666 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Getting quotas for user a459d3c9943f4c0281113828efc00dde and project 66bd43d3da6249f69f1a238934aae277. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:03:14.967989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:03:14.970922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:03:15.015158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-400ee79c-2225-4524-a97e-62165b487326 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475015 Jan 11 04:03:15.015800 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 390/766] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:03:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:03:15.026944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0bbee6d3-8e55-446b-81bc-4dc423510517 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:15.027645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0bbee6d3-8e55-446b-81bc-4dc423510517 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:15.082093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0bbee6d3-8e55-446b-81bc-4dc423510517 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:15.088616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0bbee6d3-8e55-446b-81bc-4dc423510517 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1218 microversion: 2.1 time: 0.065695 Jan 11 04:03:15.089178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 377/767] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:15 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:15.887904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:15.888882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:15.895715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:15.896158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:15.896931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:15.897362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:16.039513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-94437d48-1010-41ad-8f91-7a574d9683e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.155648 Jan 11 04:03:16.040238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 391/768] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:15 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:16.106741 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:16.107992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:16.117070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:16.117528 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:16.118353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:16.118780 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:16.186957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:16.194440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ea663ffc-3c81-41e1-947b-6647471afb49 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1278 microversion: 2.1 time: 0.092092 Jan 11 04:03:16.195227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 378/769] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:16 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:17.051379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:17.052391 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:17.059191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:17.059649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:17.060439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:17.060878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:17.146616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8272e9de-d0dc-494a-bc5e-04983ae72730 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.099605 Jan 11 04:03:17.147358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 392/770] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:17 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:17.211340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:17.211977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:17.218196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:17.218644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:17.219428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:17.219865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:17.444951 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:17.452966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-46b90e72-2953-45ac-bb39-337e5839d18c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.245344 Jan 11 04:03:17.453548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 379/771] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:17 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:17.543437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-a795522f-4755-43f6-88e8-7ec29ce42acf req-fa38926d-e3e2-495e-bb99-ebddec8f5a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1920ca25-021b-42e2-9e73-75042183e8b6", "tag": "ce391670-4994-4c81-a2f2-6b33cb99dfea"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:17.544989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:03:17.544989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:03:17.553629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a795522f-4755-43f6-88e8-7ec29ce42acf req-fa38926d-e3e2-495e-bb99-ebddec8f5a93 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:17.554111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a795522f-4755-43f6-88e8-7ec29ce42acf req-fa38926d-e3e2-495e-bb99-ebddec8f5a93 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:17.563825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-a795522f-4755-43f6-88e8-7ec29ce42acf req-fa38926d-e3e2-495e-bb99-ebddec8f5a93 service nova] Creating event network-changed:ce391670-4994-4c81-a2f2-6b33cb99dfea for instance 1920ca25-021b-42e2-9e73-75042183e8b6 on hv-cinder-81977 Jan 11 04:03:17.568658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-a795522f-4755-43f6-88e8-7ec29ce42acf req-fa38926d-e3e2-495e-bb99-ebddec8f5a93 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160675 Jan 11 04:03:17.569246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 393/772] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:03:18.157874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:18.158819 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:18.165120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:18.165569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:18.166385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:18.166821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:18.257692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2253bb45-8595-4b8b-be43-7549f71bdfaa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.103585 Jan 11 04:03:18.258355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 380/773] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:18 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:18.470612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:18.471310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:18.477261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:18.477748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:18.478532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:18.478966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:18.612820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:18.619947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-87680b16-2455-46e4-a420-2fcee444017e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.153734 Jan 11 04:03:18.620508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 394/774] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:18 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:03:19.270510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:19.271445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:19.278403 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:19.278952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:19.280002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:19.280434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:19.371572 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7a2104f2-6ad0-460d-b6ab-f707a749d387 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.105662 Jan 11 04:03:19.372191 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 381/775] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:19 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:19.636950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:19.637598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:19.644554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:19.645054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:19.645878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:19.646320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:19.770983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:19.778124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-54e49a47-f35c-4201-80ae-bf98b394f2c6 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.144836 Jan 11 04:03:19.778681 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 395/776] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:19 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:20.383487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:20.384471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:20.391285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:20.391727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:20.392522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:20.392953 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:20.485244 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-011e98b9-d996-4a8c-bb6a-e3010915c8f7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.105634 Jan 11 04:03:20.486584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 382/777] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:20 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:20.794823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:20.795365 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:20.802225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:20.802675 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:20.803456 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:20.803892 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:20.932648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:20.940426 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-67a19620-2eb9-493d-af12-d76fad4445f5 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.149443 Jan 11 04:03:20.940986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 396/778] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:20 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:21.497995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:21.498990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:21.506548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:21.507018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:21.507824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:21.508258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:21.596352 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6bbfb856-453f-4e1f-93c8-611b09b6ed8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.102393 Jan 11 04:03:21.596952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 383/779] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:21 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:21.957905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:21.958515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:21.964944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:21.965395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:21.966203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:21.966643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:22.097105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:22.104730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cd145b3b-af58-4082-b393-29a49a7a8b89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.151038 Jan 11 04:03:22.105305 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 397/780] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:21 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:22.608637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:22.609646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:22.617102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:22.617547 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:22.618350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:22.618782 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:22.708315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-12e1c6a6-d41f-428d-80d9-bffb55d08886 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.103690 Jan 11 04:03:22.708995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 384/781] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:22 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:23.120973 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:23.121580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:23.128140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:23.128617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:23.129372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:23.129840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:23.258974 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:23.266074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b2a15514-6954-4dd5-a84e-68c8f5782acc tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.148797 Jan 11 04:03:23.266634 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 398/782] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:23 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:23.719534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:23.720559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:23.727436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:23.727882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:23.728654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:23.729089 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:23.817135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dfc6d33e-3e22-40c2-bf11-54dc7853c671 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.101548 Jan 11 04:03:23.817774 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 385/783] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:23 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:24.142521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-0c4594e4-9ca0-4e5d-96e8-7831b60f3088 req-138ef044-0e15-4d88-98c1-e4554d925008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1920ca25-021b-42e2-9e73-75042183e8b6", "name": "network-vif-plugged", "status": "completed", "tag": "ce391670-4994-4c81-a2f2-6b33cb99dfea"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:24.144139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:03:24.144139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:03:24.150940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0c4594e4-9ca0-4e5d-96e8-7831b60f3088 req-138ef044-0e15-4d88-98c1-e4554d925008 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:24.151388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0c4594e4-9ca0-4e5d-96e8-7831b60f3088 req-138ef044-0e15-4d88-98c1-e4554d925008 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:24.162805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-0c4594e4-9ca0-4e5d-96e8-7831b60f3088 req-138ef044-0e15-4d88-98c1-e4554d925008 service nova] Creating event network-vif-plugged:ce391670-4994-4c81-a2f2-6b33cb99dfea for instance 1920ca25-021b-42e2-9e73-75042183e8b6 on hv-cinder-81977 Jan 11 04:03:24.167627 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-0c4594e4-9ca0-4e5d-96e8-7831b60f3088 req-138ef044-0e15-4d88-98c1-e4554d925008 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085402 Jan 11 04:03:24.168206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 399/784] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:24.284156 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:24.284759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:24.291627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:24.292078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:24.292854 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:24.293285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:24.476376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:24.483537 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a09e5664-1015-4050-b7a9-f3b52cf931ad tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.204278 Jan 11 04:03:24.484094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 386/785] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:24 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:24.828862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:24.830522 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:24.836567 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:24.837017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:24.837823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:24.838263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:24.932096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-37a6d9fc-91fb-437f-9d1d-4b3a82d1c312 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.107169 Jan 11 04:03:24.932761 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 400/786] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:24 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:25.499857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:25.503759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:25.508119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:25.508559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:25.509382 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:25.509923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:25.638132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:25.645208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-00008a60-b589-4bce-baa8-098d98369876 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1318 microversion: 2.1 time: 0.148957 Jan 11 04:03:25.645786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 387/787] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:25 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:25.943511 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:25.944504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:25.951404 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:25.951851 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:25.952625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:25.953066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:26.076385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5b264bf6-9c5d-4036-b31e-84f582e8acbb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.136775 Jan 11 04:03:26.077035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 401/788] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:25 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:26.661564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:26.662199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:26.668395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:26.668836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:26.669603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:26.670059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:26.795589 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:26.803337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-78a37a79-03e4-4efb-8dd3-94acee32cede tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1507 microversion: 2.1 time: 0.145445 Jan 11 04:03:26.803917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 388/789] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:26 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:27.088855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:27.090124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:27.097567 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:27.098027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:27.098825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:27.099267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:27.194210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-de96394b-5484-40ab-9fde-00b482551463 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28184 microversion: 2.20 time: 0.109140 Jan 11 04:03:27.195117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 402/790] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:27 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28184 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:28.205264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:28.206191 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:28.212359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:28.212788 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:28.213566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:28.214023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:28.348254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9ca44788-69cc-43c1-bc86-fe5bfbc0275f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28280 microversion: 2.20 time: 0.146381 Jan 11 04:03:28.348907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 389/791] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:28 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:29.360204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:29.361203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:29.368070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:29.368515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:29.369290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:29.369753 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:29.466861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e39fb64d-544e-4813-9fe0-5832d16581ef tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28474 microversion: 2.20 time: 0.110472 Jan 11 04:03:29.467537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 403/792] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:29 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28474 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:30.478836 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:30.479829 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:30.486721 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:30.487168 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:30.488457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:30.488892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:30.602936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a8975435-e8f8-4c50-a473-6ea92e68ad34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.128201 Jan 11 04:03:30.603578 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 390/793] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:30 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:31.615046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:31.615957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:31.622776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:31.623235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:31.623991 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:31.624424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:31.721455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-58a3700e-2388-4ea4-8e40-f65c4f7ca613 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.110384 Jan 11 04:03:31.722153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 404/794] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:31 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:32.733402 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:32.734364 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:32.741164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:32.741610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:32.742412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:32.742849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:32.833010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e4c31b2a-df18-4bed-a786-52172fc1c959 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.103596 Jan 11 04:03:32.833658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 391/795] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:32 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:33.844881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:33.845905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:33.853798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:33.854247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:33.855052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:33.855489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:33.962508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e9c9b52e-409c-4c4b-b406-e9cfa0797b2f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.121390 Jan 11 04:03:33.963185 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 405/796] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:33 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:34.974602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:34.975602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:34.982436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:34.982888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:34.983663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:34.984096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:35.079244 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-beefa821-9596-455f-898b-f47d144d7974 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.108484 Jan 11 04:03:35.079992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 392/797] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:34 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:36.092151 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:36.093153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:36.100011 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:36.100448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:36.101262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:36.101718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:36.205473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-53ad7dd2-c8cb-445a-952e-379576d9989f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.117038 Jan 11 04:03:36.206760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 406/798] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:36 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:37.218170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:37.219082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:37.226512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:37.226959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:37.227738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:37.228172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:37.318041 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-822d83da-0170-47be-a44c-75b41e22653d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.103776 Jan 11 04:03:37.318698 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 393/799] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:37 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:38.329879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:38.330870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:38.337623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:38.338098 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:38.338860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:38.339291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:38.437324 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ea81675f-a50e-47b3-a5d0-bb7ebba5a3ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.111318 Jan 11 04:03:38.437985 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 407/800] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:38 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:39.327317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1214849636"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:39.327931 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:39.334827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:39.335270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:39.336040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:39.336474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:39.449489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:39.450419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:39.457091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:39.457536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:39.458338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:39.458772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:39.462753 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.network.security_group_api [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Removing security group cc58dce6-d76b-46a4-a365-b0c225fc104b from port 8ca3ad13-c0eb-4d6c-8401-30168e256551 Jan 11 04:03:39.549377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-27f3a981-166b-4a25-b04c-6eabf0a5d8c0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.103815 Jan 11 04:03:39.550307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 408/801] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:39 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:39.787031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-12fd5a56-3041-4d1d-8ffd-ac8824de0853 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action" status: 202 len: 0 microversion: 2.1 time: 0.463667 Jan 11 04:03:39.787726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 394/802] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:03:39 2022] POST /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:39.800832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-d1343143-bc80-4f50-b58a-e49f06f3a8b6 req-82a10b51-1e82-4171-97a0-fe60bf77e7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:39.803111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:03:39.803111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:03:39.812588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-d1343143-bc80-4f50-b58a-e49f06f3a8b6 req-82a10b51-1e82-4171-97a0-fe60bf77e7f7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:39.813220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-d1343143-bc80-4f50-b58a-e49f06f3a8b6 req-82a10b51-1e82-4171-97a0-fe60bf77e7f7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:39.829444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-d1343143-bc80-4f50-b58a-e49f06f3a8b6 req-82a10b51-1e82-4171-97a0-fe60bf77e7f7 service nova] Creating event network-changed:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 04:03:39.834753 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-d1343143-bc80-4f50-b58a-e49f06f3a8b6 req-82a10b51-1e82-4171-97a0-fe60bf77e7f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038067 Jan 11 04:03:39.835612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 409/803] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:40.561874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:40.562905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:40.572652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:40.573105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:40.573963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:40.574403 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:40.669557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5941cfb5-b86a-48f6-93ff-4fa0b8e9d825 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.111691 Jan 11 04:03:40.673488 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 395/804] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:40 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:41.047195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:41.047840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:41.049014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-bfc66b95-f3c8-4add-a788-2aae514625ef req-632adfa7-e0e2-446e-8e9e-83fcc6e98c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:41.050670 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:03:41.050670 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:03:41.054834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.055459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.056277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.056717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.059475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-bfc66b95-f3c8-4add-a788-2aae514625ef req-632adfa7-e0e2-446e-8e9e-83fcc6e98c69 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.059928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-bfc66b95-f3c8-4add-a788-2aae514625ef req-632adfa7-e0e2-446e-8e9e-83fcc6e98c69 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.071560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-bfc66b95-f3c8-4add-a788-2aae514625ef req-632adfa7-e0e2-446e-8e9e-83fcc6e98c69 service nova] Creating event network-changed:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 04:03:41.077276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-bfc66b95-f3c8-4add-a788-2aae514625ef req-632adfa7-e0e2-446e-8e9e-83fcc6e98c69 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032564 Jan 11 04:03:41.077912 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 396/805] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:03:41.140360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lazy-loading 'services' on Instance uuid 68a6eff1-855e-45d8-8638-579171cf662b {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:03:41.212730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0ac88eed-d8b5-4d94-b242-17fe6e544448 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments/8797f157-96c4-48f7-8249-c90ed505a7a6" status: 202 len: 0 microversion: 2.1 time: 0.170261 Jan 11 04:03:41.213709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 410/806] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:03:41 2022] DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments/8797f157-96c4-48f7-8249-c90ed505a7a6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:41.222988 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:41.224790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:41.232633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.233172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.234236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.235041 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.274447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b7814c5e-8fd0-4e26-bafb-110490dcf397 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055742 Jan 11 04:03:41.275495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 397/807] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:03:41 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:41.681884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:41.683325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:41.689473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.690045 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.690918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:41.691430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:41.932831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63608b40-6af1-4073-922a-b47d6b43b72a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.255255 Jan 11 04:03:41.933482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 411/808] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:41 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:42.286119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:42.286955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:42.293054 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:42.293508 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:42.294327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:42.294766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:42.323890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f7380ec4-6394-42c0-b925-079c51da30ca tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Jan 11 04:03:42.324435 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 398/809] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:03:42 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:42.945274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:42.946301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:42.953137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:42.953586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:42.954396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:42.954849 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:43.083907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-47885343-a75a-4e9f-b6e5-7d92af8b421b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.143061 Jan 11 04:03:43.084546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 412/810] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:42 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:43.336187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:43.337100 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:43.343391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:43.343842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:43.344618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:43.345062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:43.372846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-15d1de26-c735-4975-9e3d-f01d0a5610de tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040429 Jan 11 04:03:43.373391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 399/811] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:03:43 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:03:43.384153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:43.384736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:43.391487 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:43.391938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:43.392718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:43.393175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:43.614754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] HTTP exception thrown: Instance 68a6eff1-855e-45d8-8638-579171cf662b is not attached to volume 8797f157-96c4-48f7-8249-c90ed505a7a6 Jan 11 04:03:43.615361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Returning 404 to user: Instance 68a6eff1-855e-45d8-8638-579171cf662b is not attached to volume 8797f157-96c4-48f7-8249-c90ed505a7a6 {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:03:43.616222 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a2fd124c-dbe8-484f-b967-3b5ed2e4820f tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments/8797f157-96c4-48f7-8249-c90ed505a7a6" status: 404 len: 154 microversion: 2.1 time: 0.236978 Jan 11 04:03:43.616763 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 413/812] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:03:43 2022] DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b/os-volume_attachments/8797f157-96c4-48f7-8249-c90ed505a7a6 => generated 154 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:03:44.096313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:44.097222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:44.103980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.104429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:44.105208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.105651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:44.216871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-52cd9216-7e25-4499-824d-9c64b2f9fb66 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.124070 Jan 11 04:03:44.217437 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 400/813] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:44 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:44.744702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:44.745195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:44.751825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.752269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:44.753036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.753468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:44.777070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:03:44.850102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-819eb810-14b3-4d46-b1f0-17f177c10adc tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 204 len: 0 microversion: 2.1 time: 0.109002 Jan 11 04:03:44.850675 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 414/814] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:03:44 2022] DELETE /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:03:44.859520 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:44.862378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:44.870960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.871412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:44.872200 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:44.872641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:45.002278 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:45.010905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4d110c2b-915e-4878-8d51-fda3c43141fb tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1556 microversion: 2.1 time: 0.155441 Jan 11 04:03:45.011472 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 401/815] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:44 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:45.228933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:45.229983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:45.236210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:45.236656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:45.237429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:45.237886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:45.323329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a56e19a1-42a6-4179-94ec-4e3083743a71 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.098363 Jan 11 04:03:45.323940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 415/816] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:45 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:46.028016 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:46.028629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:46.035240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:46.035686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:46.036468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:46.036924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:46.164689 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:46.172350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6e15ecbb-8d83-4039-a21b-756072f6ee79 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1556 microversion: 2.1 time: 0.148230 Jan 11 04:03:46.172852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 402/817] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:46 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:46.336720 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:46.337821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:46.344534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:46.344983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:46.345778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:46.346212 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:46.435088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-338d7e52-1db1-40af-96b5-f6326f6ae736 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.102693 Jan 11 04:03:46.435613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 416/818] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:46 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:47.190961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:47.191502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:47.197805 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:47.198249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:47.199021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:47.199452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:47.325552 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:47.332795 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-03e74d35-4067-470a-aca6-75c5205f5808 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1556 microversion: 2.1 time: 0.147037 Jan 11 04:03:47.333371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 403/819] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:47 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:47.447205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:47.448128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:47.454976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:47.455428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:47.456205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:47.456641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:47.660052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-898048c4-1ded-4f0a-9121-13466c97db5d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.216785 Jan 11 04:03:47.660673 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 417/820] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:47 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:48.210917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-9833ff07-fd89-47f2-a00c-1878c2877b57 req-66cb720e-fbf4-4a74-a84e-53fe067f0432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a6eff1-855e-45d8-8638-579171cf662b", "name": "network-vif-deleted", "tag": "8ca3ad13-c0eb-4d6c-8401-30168e256551"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:48.212512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:03:48.212512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:03:48.220556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-9833ff07-fd89-47f2-a00c-1878c2877b57 req-66cb720e-fbf4-4a74-a84e-53fe067f0432 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.221002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-9833ff07-fd89-47f2-a00c-1878c2877b57 req-66cb720e-fbf4-4a74-a84e-53fe067f0432 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.232372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-9833ff07-fd89-47f2-a00c-1878c2877b57 req-66cb720e-fbf4-4a74-a84e-53fe067f0432 service nova] Creating event network-vif-deleted:8ca3ad13-c0eb-4d6c-8401-30168e256551 for instance 68a6eff1-855e-45d8-8638-579171cf662b on hv-cinder-81977 Jan 11 04:03:48.237324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-9833ff07-fd89-47f2-a00c-1878c2877b57 req-66cb720e-fbf4-4a74-a84e-53fe067f0432 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030041 Jan 11 04:03:48.237935 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 404/821] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:48.352797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:48.353422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:48.359932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.360388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.361179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.361825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.394133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.394581 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.395539 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lazy-loading 'fault' on Instance uuid 68a6eff1-855e-45d8-8638-579171cf662b {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:03:48.434896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d96ebc2f3514fbf98304b1b67091342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c185896a967e435eab256ec6827425a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:03:48.442243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e59e9920-8fae-4f6c-8723-0248d92cc586 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 200 len: 1349 microversion: 2.1 time: 0.096345 Jan 11 04:03:48.442799 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 418/822] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:48 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:03:48.671857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:48.672856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:48.679159 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.679611 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.680394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:48.680828 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:48.778905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a111cee5-8f68-49af-8e4f-69c09b4adae8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.110848 Jan 11 04:03:48.779557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 405/823] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:48 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:49.458970 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:49.459495 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] [instance: 68a6eff1-855e-45d8-8638-579171cf662b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:49.465815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:49.466269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:49.467058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:49.467498 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:49.480942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] HTTP exception thrown: Instance 68a6eff1-855e-45d8-8638-579171cf662b could not be found. Jan 11 04:03:49.481562 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Returning 404 to user: Instance 68a6eff1-855e-45d8-8638-579171cf662b could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:03:49.482408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-08c8a5a0-0b3b-4da5-a0a5-20b43a66762d tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b" status: 404 len: 111 microversion: 2.1 time: 0.027369 Jan 11 04:03:49.482929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 419/824] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:03:49 2022] GET /compute/v2.1/servers/68a6eff1-855e-45d8-8638-579171cf662b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:03:49.492266 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ba8876a5-e385-4af2-ac0b-b034f2286fa7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] Calling method '.version_select at 0x7f4e659465e0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:03:49.513480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ba8876a5-e385-4af2-ac0b-b034f2286fa7 tempest-TestMinimumBasicScenario-1382749002 tempest-TestMinimumBasicScenario-1382749002-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2058116597" status: 202 len: 0 microversion: 2.1 time: 0.025676 Jan 11 04:03:49.514087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 406/825] 10.222.0.24 () {58 vars in 1271 bytes} [Tue Jan 11 04:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2058116597 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:49.791710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:49.792632 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:49.798553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:49.799006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:49.799910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:49.800355 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:49.903224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-65a7548e-ad35-4df1-9c48-86b3c1528ace tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.115181 Jan 11 04:03:49.907616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 420/826] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:49 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:50.214884 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93002740-a6f3-4943-9425-dcfce03ddcde", "device": "/dev/sdb"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:50.216777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:50.224412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:50.224935 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:50.225825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:50.226329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:50.493373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-621bb683-aa68-43da-ba7f-1b5365d4ee9e tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "POST /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288851 Jan 11 04:03:50.495679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 407/827] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:03:50 2022] POST /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:03:50.916307 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:50.918128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:50.925776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:50.926920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:50.927828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:50.928387 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:51.019012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3d95b06e-581c-4b97-91e3-0b1c78fb5e04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.106728 Jan 11 04:03:51.024895 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 421/828] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:50 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:52.033289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:52.034433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:52.045126 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:52.047452 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:52.048525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:52.053941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:52.157704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-02c016c3-ca09-4c07-9ab1-e33437142e7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.128963 Jan 11 04:03:52.158361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 408/829] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:52 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:53.169790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:53.171476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:53.182134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:53.182582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:53.183537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:53.183980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:53.291457 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-44c72eaf-0602-4028-9df3-44f5b63acd87 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.125539 Jan 11 04:03:53.292252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 422/830] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:53 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:54.304235 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:54.305221 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:54.312041 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:54.312482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:54.313258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:54.313702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:54.399027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4278f5be-3aa3-4173-a154-7a7238750ee6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.099143 Jan 11 04:03:54.399711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 409/831] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:54 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:55.412522 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:55.413546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:55.420910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:55.421364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:55.422195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:55.422636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:55.517013 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d609930f-c8f6-4ff9-8f2f-193753d7f239 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.109069 Jan 11 04:03:55.517980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 423/832] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:55 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:56.528905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:56.530964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:56.538306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:56.539015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:56.539991 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:56.540835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:56.632061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-998c595c-8cf6-4971-8ce2-653815ac0982 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.107090 Jan 11 04:03:56.634101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 410/833] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:56 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:57.645470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:57.646546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:57.654036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:57.654489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:57.655563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:57.655998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:57.740798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b3e35f27-3780-4d00-b9c9-e8d502e4918e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.099704 Jan 11 04:03:57.745411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 424/834] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:57 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:03:58.752887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:58.753921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:58.760758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:58.761206 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:58.762018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:58.762457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:58.850109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4aed6196-6493-4687-bbd4-f2bfd4d6bd6c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.101152 Jan 11 04:03:58.850724 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 411/835] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:58 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:03:59.861437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:03:59.862492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:03:59.869295 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:59.869906 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:03:59.870685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:03:59.871122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:02.179351 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bf73b611-f1b4-4a21-8d88-394427242b39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 2.321646 Jan 11 04:04:02.179952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 425/836] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:03:59 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:03.191122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:03.192073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:03.198893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:03.199345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:03.200120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:03.200557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:03.283558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-023296e0-12b7-49f2-80aa-3ed4e22caa0d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.096431 Jan 11 04:04:03.287979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 412/837] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:03 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:04.141036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:04:04.141210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:04:04.296080 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:04.296992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:04.305187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:04.305661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:04.306562 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:04.307025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:07.150084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-88e7c873-6617-4c56-8ccb-1ee6d412acb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 2.857846 Jan 11 04:04:07.150735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 426/838] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:04 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 2860 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:08.163107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:08.164099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:08.177296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:08.177711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:08.178484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:08.178913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:08.280504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-757e9856-2c88-4198-9c46-7dd281254713 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.121584 Jan 11 04:04:08.281124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 413/839] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:08 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:09.180550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:04:09.181052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:04:09.292336 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:09.293333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:09.301409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:09.301890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:09.302669 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:09.303109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:12.632461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-324c2bff-35ae-4598-b8ea-35aa840ee5b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 3.343892 Jan 11 04:04:12.633116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 427/840] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:09 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 3346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:13.644556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:13.645541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:13.652312 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:13.652754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:13.653529 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:13.653988 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:13.735165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3abecf7f-be3a-428a-89e7-bd79dddf473e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.094515 Jan 11 04:04:13.735776 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 414/841] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:13 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:14.684472 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:14.685094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:14.693285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.693755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.694535 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.694986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.716727 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lazy-loading 'flavor' on Instance uuid 13cea542-b8d0-4bfc-a01f-ef913909d696 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:04:14.747577 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:14.748565 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:14.755924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.756367 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.757139 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.757566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.786504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-316173a4-438c-4483-98ea-a72248e6b21f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "POST /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696/action" status: 202 len: 0 microversion: 2.1 time: 0.105879 Jan 11 04:04:14.787155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 428/842] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:04:14 2022] POST /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:14.795546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:14.796244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:14.802870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.803317 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.804090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:14.804550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:14.876602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-aec18de2-317c-4115-a35b-37648063ae8c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.133141 Jan 11 04:04:14.877869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 415/843] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:14 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:04:14.940253 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:14.947880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1b43309f-2b19-4896-90dd-b1d2c6982c3d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.156025 Jan 11 04:04:14.948386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 429/844] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:14 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:15.889271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:15.890297 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:15.897916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:15.898371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:15.899153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:15.899595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:15.965330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:15.965962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:15.972724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:15.973170 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:15.973982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:15.974412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:15.985088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-98dafe94-1585-405f-b8ad-9e73987c8d26 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.099445 Jan 11 04:04:15.987718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 416/845] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:15 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:16.113626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:16.120936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a5aad4f0-0eda-4ad6-bc38-b6c28054d9ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.159456 Jan 11 04:04:16.121507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 430/846] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:15 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:16.997135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:16.998164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:17.005539 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.006013 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.006776 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.007206 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.080697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:17.081190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:17.087561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.088013 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.088793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.089232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.102039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-834b1f0b-fd50-42f0-9b59-ad31a90e7f70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.108706 Jan 11 04:04:17.102954 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 417/847] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:16 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:17.138046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:17.138769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:17.145833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.146418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.147202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:17.147637 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:17.166858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'services' on Instance uuid 1920ca25-021b-42e2-9e73-75042183e8b6 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:04:17.233905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ffc3e0b1-5493-400a-bbab-86bdb0d8a5b7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6/os-volume_attachments/93002740-a6f3-4943-9425-dcfce03ddcde" status: 202 len: 0 microversion: 2.1 time: 0.156525 Jan 11 04:04:17.234566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 431/848] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:04:17 2022] DELETE /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6/os-volume_attachments/93002740-a6f3-4943-9425-dcfce03ddcde => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:17.291455 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:17.298935 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0604c6c5-e2c0-446e-bc02-a898b8308a26 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.164916 Jan 11 04:04:17.299488 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 418/849] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:17 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:18.114529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:18.115619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:18.122046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.122497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.123284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.123755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.209810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f6d7bb93-9d05-42de-9811-8a465a8fac30 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.099530 Jan 11 04:04:18.210382 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 432/850] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:18 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:18.315791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:18.317038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:18.323271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.323717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.324490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.324921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.342864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:18.343451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:18.350263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.350719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.351499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.351942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.377162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:04:18.453187 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-112817dd-b098-434e-b221-3865f07b4f31 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 204 len: 0 microversion: 2.1 time: 0.113962 Jan 11 04:04:18.453847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 433/851] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:04:18 2022] DELETE /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 04:04:18.455347 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:18.462328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:18.462971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:18.463130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-99039334-e633-4ddd-9100-28f31c842ca7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.150903 Jan 11 04:04:18.465758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 419/852] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:18 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:18.468643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.469096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.469919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:18.470360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:18.603398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:18.610875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-aaf77b7a-5ca0-4a56-a4a4-1222aa7f6675 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1513 microversion: 2.1 time: 0.152468 Jan 11 04:04:18.611433 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 434/853] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:18 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:19.221332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:19.222272 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:19.229147 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.229596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.230415 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.230854 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.327384 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-87286e7b-0743-4590-bb4c-0b3dcde8eeb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.109857 Jan 11 04:04:19.328018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 420/854] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:19 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:19.478661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:19.479236 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:19.485510 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.485988 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.486770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.487210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.613868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:19.623060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b321404c-ce65-4c85-9b91-98b735950b9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.147846 Jan 11 04:04:19.623726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 435/855] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:19 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:19.630084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:19.630787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:19.637501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.637983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.638761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:19.639197 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:19.768255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:19.776608 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-00bb88bd-c678-4042-8aaa-ec44c07cdc20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1513 microversion: 2.1 time: 0.151010 Jan 11 04:04:19.777168 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 421/856] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:19 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:20.339066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:20.340066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:20.346427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.346883 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.348239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.348683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.430721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e355ef85-0720-4ec8-9143-f2a1f24b940d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.095253 Jan 11 04:04:20.431388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 436/857] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:20 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:20.640091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:20.640623 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:20.646867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.647311 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.648076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.648501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.778505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:20.785963 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-46474861-5c74-4c9e-8074-31f6bc4853eb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.149550 Jan 11 04:04:20.786561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 422/858] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:20 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:20.793074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:20.793819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:20.801133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.801583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.802386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:20.802822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:20.934479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:20.942161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-408bc1dd-268a-4fa0-8462-5099d9ab7087 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1513 microversion: 2.1 time: 0.153134 Jan 11 04:04:20.942714 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 437/859] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:20 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:21.441580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:21.442533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:21.448705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.449151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.449965 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.450402 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.540223 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1bb8b367-7cc1-46fc-aac9-ce7496732514 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.102067 Jan 11 04:04:21.540788 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 423/860] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:21 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:21.650890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-dec91f5c-241c-454a-9549-595015d597f6 req-d59fa28c-b4b8-4eb4-b052-1f2bc4dd6163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1920ca25-021b-42e2-9e73-75042183e8b6", "name": "network-vif-deleted", "tag": "ce391670-4994-4c81-a2f2-6b33cb99dfea"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:21.652314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:21.652314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:21.659821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-dec91f5c-241c-454a-9549-595015d597f6 req-d59fa28c-b4b8-4eb4-b052-1f2bc4dd6163 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.660306 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-dec91f5c-241c-454a-9549-595015d597f6 req-d59fa28c-b4b8-4eb4-b052-1f2bc4dd6163 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.670983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-dec91f5c-241c-454a-9549-595015d597f6 req-d59fa28c-b4b8-4eb4-b052-1f2bc4dd6163 service nova] Creating event network-vif-deleted:ce391670-4994-4c81-a2f2-6b33cb99dfea for instance 1920ca25-021b-42e2-9e73-75042183e8b6 on hv-cinder-81977 Jan 11 04:04:21.675676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-dec91f5c-241c-454a-9549-595015d597f6 req-d59fa28c-b4b8-4eb4-b052-1f2bc4dd6163 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028672 Jan 11 04:04:21.676255 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 438/861] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:04:21.803417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:21.804124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:21.811322 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.811765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.812553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.812986 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.947762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:21.955151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b235b786-2c5a-478d-b355-1fdc9a124d2e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.156141 Jan 11 04:04:21.955709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 424/862] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:21 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:21.958944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:21.959648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:21.965640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.966115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.966900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.967334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.997651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:21.998122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:21.998573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid 1920ca25-021b-42e2-9e73-75042183e8b6 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:04:22.037468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:22.044705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9728fe17-a5da-4cc4-b87a-c79cdc5b4c34 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 200 len: 1308 microversion: 2.1 time: 0.090323 Jan 11 04:04:22.045258 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 439/863] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:21 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:22.551995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:22.552910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:22.559246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:22.559696 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:22.560480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:22.560916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:22.647981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d09e5b66-6ae2-4446-829a-7199908953dc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 28642 microversion: 2.20 time: 0.099658 Jan 11 04:04:22.648600 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 425/864] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:22 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 28642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:22.972230 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:22.973379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:22.979610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:22.980058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:22.980830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:22.981262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:23.061953 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:23.062652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: 1920ca25-021b-42e2-9e73-75042183e8b6] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:23.069550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:23.070028 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:23.070822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:23.071260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:23.085138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] HTTP exception thrown: Instance 1920ca25-021b-42e2-9e73-75042183e8b6 could not be found. Jan 11 04:04:23.085785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Returning 404 to user: Instance 1920ca25-021b-42e2-9e73-75042183e8b6 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:04:23.086610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-adb8ff07-cb52-4e5e-9b21-07d7206e78c1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6" status: 404 len: 111 microversion: 2.1 time: 0.028705 Jan 11 04:04:23.087153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 426/865] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:23 2022] GET /compute/v2.1/servers/1920ca25-021b-42e2-9e73-75042183e8b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 04:04:23.111261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:23.121002 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4ba41db7-b30a-4554-a7b4-33a0bf7562b4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.152217 Jan 11 04:04:23.121577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 440/866] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:22 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:23.659650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:23.660606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:23.666835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:23.667284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:23.668061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:23.668496 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:24.138492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:24.139105 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:24.145393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:24.145886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:24.146665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:24.147102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:24.279894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:24.288344 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-43bb355c-ef6c-4134-8dda-67153e688dd5 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.153550 Jan 11 04:04:24.289195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 441/867] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:24 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:25.306267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:25.306836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:25.313526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:25.314021 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:25.314844 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:25.315287 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:25.442210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:25.449369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-81290140-dc59-427b-8ead-b4de9c60c723 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.146837 Jan 11 04:04:25.449952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 442/868] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:25 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:26.465574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:26.466202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:26.473088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:26.473526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:26.474318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:26.474768 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:26.601308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:26.608489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6e1813e4-ed2e-4aa6-8241-c0260238d2cb tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.146501 Jan 11 04:04:26.609040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 443/869] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:26 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:26.785894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1e72f030-6896-4ddb-86e9-133dec62de0a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 34170 microversion: 2.20 time: 3.129220 Jan 11 04:04:26.786531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 427/870] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:23 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 34170 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:27.624919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:27.625566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:27.632377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:27.632829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:27.633614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:27.634077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:27.766560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:27.775384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-abeb8470-76db-4991-82c7-4c6f753b597d tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.153766 Jan 11 04:04:27.775955 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 444/871] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:27 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:27.798809 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:27.799869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:27.808166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:27.808615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:27.809398 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:27.809864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:27.905210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d5b8541e-c965-4b8d-9291-104348dc9f3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 35184 microversion: 2.20 time: 0.110255 Jan 11 04:04:27.905871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 428/872] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:27 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 35184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:28.792153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:28.792785 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:28.799010 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:28.799463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:28.800318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:28.800881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:28.917366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:28.918427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:28.929329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:28.929817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:28.930615 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:28.931058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:28.932149 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:28.940744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cc55b293-f03f-4b9f-b514-8eb76d5f09cf tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.152206 Jan 11 04:04:28.941319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 445/873] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:28 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:29.298536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dbacdd18-9d42-4372-973b-e410d6343c9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 36521 microversion: 2.20 time: 0.384897 Jan 11 04:04:29.299368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 429/874] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:28 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 36521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:29.957962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:29.958608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:29.964931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:29.965332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:29.966151 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:29.966591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:30.092968 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:30.100750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2755e54c-ba84-4a11-af47-a8078c0a0afc tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.146456 Jan 11 04:04:30.101311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 446/875] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:29 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:30.310560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:30.311564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:30.318429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:30.318878 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:30.319658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:30.320096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:31.117459 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:31.118098 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:31.124389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:31.124835 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:31.125614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:31.126074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:31.258361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:31.265562 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-60b94da7-d602-4f6b-b18b-b168ee178873 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.151731 Jan 11 04:04:31.266149 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 447/876] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:31 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:32.282214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:32.282855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:32.289022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:32.289469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:32.290264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:32.290697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:32.422681 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:32.430034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-065e05e4-0738-46fd-b65f-ef93ff645135 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.151641 Jan 11 04:04:32.430621 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 448/877] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:32 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:32.515976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-595493b8-4573-4acf-97d3-ca24351c2bbc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 38195 microversion: 2.20 time: 2.209230 Jan 11 04:04:32.520132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 430/878] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:30 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 38195 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:32.863490 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-93fa8765-8700-4046-8a1d-86103dd901b5 req-4c39286d-41c2-4068-ab0a-f51fc7cf9ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "name": "network-vif-unplugged", "status": "completed", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:32.865015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:32.865015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:32.872201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-93fa8765-8700-4046-8a1d-86103dd901b5 req-4c39286d-41c2-4068-ab0a-f51fc7cf9ecc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:32.872765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-93fa8765-8700-4046-8a1d-86103dd901b5 req-4c39286d-41c2-4068-ab0a-f51fc7cf9ecc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:32.884860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-93fa8765-8700-4046-8a1d-86103dd901b5 req-4c39286d-41c2-4068-ab0a-f51fc7cf9ecc service nova] Creating event network-vif-unplugged:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:04:32.889701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-93fa8765-8700-4046-8a1d-86103dd901b5 req-4c39286d-41c2-4068-ab0a-f51fc7cf9ecc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030502 Jan 11 04:04:32.890457 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 449/879] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:33.109639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:33.110747 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.125525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.129955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.131063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.133201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.170698 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d9ca8783-a6b2-41a1-ac90-4c587bdfc85d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065112 Jan 11 04:04:33.175847 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 431/880] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:04:33 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:04:33.226825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:33.227419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.233366 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.233841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.234616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.235046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.259916 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:04:33.331444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cf6a3775-6688-46bc-8198-ad6c7ed13d87 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 204 len: 0 microversion: 2.1 time: 0.109111 Jan 11 04:04:33.332856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 450/881] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:04:33 2022] DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:04:33.340737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:33.341339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.347596 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.348599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.349369 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.349825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.447123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:33.447822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.453537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.454018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.454793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.455228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.480501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:33.487820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-65be5435-a629-4229-b6f6-00f4098446bd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1671 microversion: 2.1 time: 0.150767 Jan 11 04:04:33.488570 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 432/882] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:33 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:33.527812 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:33.528775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.536844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.537305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.538173 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.538642 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.586960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:33.594539 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1314a598-f20f-4818-9e28-eb06fa9a7d96 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1569 microversion: 2.1 time: 0.151324 Jan 11 04:04:33.595195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 451/883] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:33 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:33.611423 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:33.611983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.617699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.618171 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.619606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.620259 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.623887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a95cf74d-9dd4-42f5-bec9-0d507acaebf6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 38195 microversion: 2.20 time: 0.099510 Jan 11 04:04:33.624581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 433/884] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:33 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 38195 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:04:33.707929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-acef4afb-e022-4789-a85f-081ddf6e2f23 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "POST /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696/action" status: 202 len: 0 microversion: 2.1 time: 0.099298 Jan 11 04:04:33.708448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 452/885] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:04:33 2022] POST /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:04:33.716786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:33.717601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:33.725360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.725846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.726629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:33.727065 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:33.860445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:33.868058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-31aeab07-b94b-400c-bd86-8e4debcefd24 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1517 microversion: 2.1 time: 0.155307 Jan 11 04:04:33.877728 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 434/886] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:33 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:33.925642 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-136546279", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "networks": [{"uuid": "41d337ad-d737-48f9-8bd1-0a792d30dc86"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:33.977278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] validate_networks() for [('41d337ad-d737-48f9-8bd1-0a792d30dc86', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:04:34.325409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:04:34.325895 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:04:34.326398 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:04:34.326816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:04:34.327235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:04:34.335702 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.336309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.336955 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.337397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.353399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Getting quotas for project 66bd43d3da6249f69f1a238934aae277. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:04:34.357376 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Getting quotas for user a459d3c9943f4c0281113828efc00dde and project 66bd43d3da6249f69f1a238934aae277. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:04:34.368719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:04:34.371341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:04:34.416878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4130ba17-eeaa-45a1-b642-2a1a5cc159c0 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494709 Jan 11 04:04:34.417641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 453/887] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:04:34.427930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a8b2795c-d125-44b4-a498-3942cb77b117 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:34.428628 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a8b2795c-d125-44b4-a498-3942cb77b117 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:34.481878 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a8b2795c-d125-44b4-a498-3942cb77b117 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:34.489869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a8b2795c-d125-44b4-a498-3942cb77b117 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1218 microversion: 2.1 time: 0.066231 Jan 11 04:04:34.490938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 435/888] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:34 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:34.504818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:34.505429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:34.512501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.513987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.514963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.515668 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.636142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:34.637784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:34.644133 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.644584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.645425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.646725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.651077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:34.660819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fb89e8b0-df40-479e-991f-daab0c2056d7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1671 microversion: 2.1 time: 0.158697 Jan 11 04:04:34.670403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 454/889] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:34 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:34.849803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e115e0f7-6473-482a-a1bb-fba50a954a8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 38293 microversion: 2.20 time: 0.217134 Jan 11 04:04:34.850456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 436/890] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:34 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 38293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:04:34.884371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:34.884987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:34.891244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.891705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:34.892503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:34.892987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.036494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:35.044520 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-957b103e-317b-4e1a-93e1-ef2553a1bbdd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1519 microversion: 2.1 time: 0.163882 Jan 11 04:04:35.045167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 455/891] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:34 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:35.510369 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:35.511202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:35.519429 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.520190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.521374 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.522038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.680153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:35.680785 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:35.687450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.687897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.688986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.689480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.919969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:35.928367 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8aa204d2-c102-4b81-beab-08ef0a76f076 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1278 microversion: 2.1 time: 0.424837 Jan 11 04:04:35.934477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 437/892] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:35 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:35.941409 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:35.946783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:35.963509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.964044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:35.964915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:35.965419 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.073939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0968b26c-34c3-409c-9fbb-a6c2e5f7fd55 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 200 len: 38336 microversion: 2.20 time: 0.135743 Jan 11 04:04:36.074927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 438/893] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:35 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 38336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:36.079926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:36.080624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:36.087658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.088164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.091490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.091983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.237284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:36.245369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-913b5b59-9b1b-4713-a6f9-05fc65c9f3cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1671 microversion: 2.1 time: 0.569684 Jan 11 04:04:36.246501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 456/894] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:35 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1671 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:36.259023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:36.259615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:36.266406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.266948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.267845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.268357 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.298774 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fb2e02d3-5fe3-4eb9-92df-ecd7341a8be3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/ips" status: 200 len: 152 microversion: 2.20 time: 0.050831 Jan 11 04:04:36.304966 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 457/895] 10.222.0.24 () {60 vars in 1288 bytes} [Tue Jan 11 04:04:36 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:04:36.443471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:36.457941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b7fafde0-e00f-4856-b438-15d4b178570e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.381183 Jan 11 04:04:36.459114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 439/896] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:36 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:36.939083 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-2c293334-2ae9-4d58-8711-4727eca13467 req-c12d99c7-65fd-47e1-b187-4bd7c1d1c6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cfea01-d609-4829-8083-058ca877eab5", "name": "network-vif-deleted", "tag": "97ee7a9f-cd30-46f2-9c18-083665b1f24e"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:36.942523 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:36.942523 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:36.953493 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:36.955098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:36.983413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.986177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.987862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.990553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:36.993948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-2c293334-2ae9-4d58-8711-4727eca13467 req-c12d99c7-65fd-47e1-b187-4bd7c1d1c6d6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:36.994379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-2c293334-2ae9-4d58-8711-4727eca13467 req-c12d99c7-65fd-47e1-b187-4bd7c1d1c6d6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.013505 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-2c293334-2ae9-4d58-8711-4727eca13467 req-c12d99c7-65fd-47e1-b187-4bd7c1d1c6d6 service nova] Creating event network-vif-deleted:97ee7a9f-cd30-46f2-9c18-083665b1f24e for instance 36cfea01-d609-4829-8083-058ca877eab5 on hv-cinder-81977 Jan 11 04:04:37.021878 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-2c293334-2ae9-4d58-8711-4727eca13467 req-c12d99c7-65fd-47e1-b187-4bd7c1d1c6d6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087198 Jan 11 04:04:37.022852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 458/897] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:04:37.252787 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:37.260867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-853b4319-ca50-4198-8440-226c54ac64ae tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.313931 Jan 11 04:04:37.261839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 440/898] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:36 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:37.270858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:37.270858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:37.270858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:37.270858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.271311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:37.271425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.303812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:37.304320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.304783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lazy-loading 'fault' on Instance uuid 36cfea01-d609-4829-8083-058ca877eab5 {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:04:37.367659 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:37.375664 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-31c99977-fbd5-403f-a4ac-764d53232898 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 200 len: 1327 microversion: 2.1 time: 0.116668 Jan 11 04:04:37.376226 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 459/899] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:37 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:37.477571 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:37.478210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:37.486584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:37.487184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.488110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:37.489636 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:37.725950 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:37.734793 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-263c5063-c8ad-458d-86e0-ab96ae0d95a0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.261229 Jan 11 04:04:37.735372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 441/900] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:37 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:38.277993 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:38.278646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:38.285101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.285559 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.286388 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.286838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.392462 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:38.393080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:38.399625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.400083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.400877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.401316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.415042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. Jan 11 04:04:38.415775 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:04:38.416599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8798b562-afa2-413b-a219-fce4c845a932 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 404 len: 111 microversion: 2.1 time: 0.028007 Jan 11 04:04:38.417321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 442/901] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:38 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 04:04:38.425122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d14b9ab4-df9c-4e3a-88c4-5bed3c11c622 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '.version_select at 0x7f4e65889310>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:38.442862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d14b9ab4-df9c-4e3a-88c4-5bed3c11c622 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729144308" status: 202 len: 0 microversion: 2.1 time: 0.021080 Jan 11 04:04:38.443760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 443/902] 10.222.0.24 () {58 vars in 1220 bytes} [Tue Jan 11 04:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729144308 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:04:38.495536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:38.503004 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-82af5070-ba12-4325-8a63-65cadf3f175c tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.228664 Jan 11 04:04:38.504753 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 460/903] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:38 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:38.510640 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:38.511538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:38.518984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.519468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.520320 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.520698 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.543711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lazy-loading 'flavor' on Instance uuid 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:04:38.753245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:38.753936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:38.761380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.761864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.762686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.763181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.818338 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a6b2092c-4653-4fdb-8e9e-acfd1b6d8998 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 202 len: 0 microversion: 2.20 time: 0.312905 Jan 11 04:04:38.819117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 444/904] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:04:38 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 11 04:04:38.827739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:38.828672 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:38.835396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.835844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:38.836794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:38.837451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:39.051872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:39.059239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-dea810d4-b470-4d21-a158-6a71713eacd2 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.310922 Jan 11 04:04:39.059804 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 461/905] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:38 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:39.064136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-73a2fa41-f418-4d7e-906d-fac5815e7e75 req-caf65490-f41a-4a93-96f4-aff6abc86c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6659a6a-85bb-40a8-aab4-4dcafd4c794b", "tag": "101914e4-0819-46d5-a457-be288226be76"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:39.065699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:39.065699 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:39.072610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-73a2fa41-f418-4d7e-906d-fac5815e7e75 req-caf65490-f41a-4a93-96f4-aff6abc86c40 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:39.073061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-73a2fa41-f418-4d7e-906d-fac5815e7e75 req-caf65490-f41a-4a93-96f4-aff6abc86c40 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:39.085180 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-73a2fa41-f418-4d7e-906d-fac5815e7e75 req-caf65490-f41a-4a93-96f4-aff6abc86c40 service nova] Creating event network-changed:101914e4-0819-46d5-a457-be288226be76 for instance d6659a6a-85bb-40a8-aab4-4dcafd4c794b on hv-cinder-81977 Jan 11 04:04:39.090119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-73a2fa41-f418-4d7e-906d-fac5815e7e75 req-caf65490-f41a-4a93-96f4-aff6abc86c40 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029192 Jan 11 04:04:39.091017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 462/906] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:39.122044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:39.130118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:39.131617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:39.132767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-56fc9bc7-886c-459f-a6f4-77660e7b656a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.309277 Jan 11 04:04:39.133505 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 445/907] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:38 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:04:39.324682 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: .version_select at 0x7f4e6571c160>, body: {"keypair": {"name": "tempest-keypair-646512566"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:39.339073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:04:39.342986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:04:39.520533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:39.521132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:39.527461 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:39.527904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:39.528668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:39.529266 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:39.723243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:39.723846 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:04:39.727620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:04:39.730387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2067ea76-1f60-480f-a2f9-de54c3892b3a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.213978 Jan 11 04:04:39.730936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 446/908] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:39 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:39.748374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-13a3092e-bc88-4f1e-9c42-38008e747e93 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.427763 Jan 11 04:04:39.748960 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 463/909] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Jan 11 04:04:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:40.076128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:40.076842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:40.083151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.083649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.084416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.084849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.151678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:40.152477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:40.159127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.159577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.160427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.160864 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.256300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:40.263845 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-894917f9-f6f1-41ce-82d6-791e1ed74d36 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.191468 Jan 11 04:04:40.264404 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 447/910] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:40 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:40.318383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:40.326183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:40.327691 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:40.328850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-793ea860-4d0a-4efe-87e8-0bbcaef8d502 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.181462 Jan 11 04:04:40.329399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 464/911] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:40 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:40.746726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:40.747373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:40.753576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.754042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.754922 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:40.755249 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:40.887658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:40.895557 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-909899bc-838d-4efc-8803-ac76d4697caa tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.152401 Jan 11 04:04:40.896335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 448/912] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:40 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:41.190026 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1669888032", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ee679d6-2a6c-49a4-a892-76737d07cced"}], "security_groups": [{"name": "tempest-securitygroup--2045320309"}], "key_name": "tempest-keypair-646512566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:41.280571 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:41.281174 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:41.286871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:41.287328 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:41.288107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:41.288543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:41.288899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] validate_networks() for [('7ee679d6-2a6c-49a4-a892-76737d07cced', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:04:41.764076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:41.771435 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d482b9d2-8596-45bc-abd3-cca6dee468fd tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.494721 Jan 11 04:04:41.772000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 449/913] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:41 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:41.776248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:41.776842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:41.782788 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:41.783238 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:41.784021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:41.784457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.005747 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.013470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.014999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.016210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-97ff9b59-49f1-4456-80f2-b0de8dbaf605 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.243244 Jan 11 04:04:42.016765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 450/914] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:41 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:42.021306 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:42.021834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:42.026453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:04:42.026929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:04:42.027329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:04:42.027734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:04:42.027835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.028142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:04:42.028284 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.029063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.029493 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.037406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.037882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.038688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.039121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.055912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:04:42.059740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Getting quotas for user b2162ca139f14ab0a7b9ae089ad4c6dd and project 9f030f843e6c46e09c485209f0b2c0b6. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:04:42.070210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:04:42.072553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:04:42.118915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6fda9c90-2b39-4f79-a98c-1541d705f4b6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.932960 Jan 11 04:04:42.119563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 465/915] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:04:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:04:42.129043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a331adaf-f29f-472f-93a2-1aa37a5f1429 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:42.129655 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a331adaf-f29f-472f-93a2-1aa37a5f1429 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:42.174215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.182918 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e5e1f8e3-1043-49e8-95ba-73a1f126654d tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.165185 Jan 11 04:04:42.183926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 451/916] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:42 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:42.190249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a331adaf-f29f-472f-93a2-1aa37a5f1429 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.198154 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a331adaf-f29f-472f-93a2-1aa37a5f1429 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1237 microversion: 2.1 time: 0.072585 Jan 11 04:04:42.199118 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 466/917] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:42 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:42.788483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:42.789103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:42.795451 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.795898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.796682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:42.797113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:42.935232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:42.942911 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b2631c82-5bc4-4602-ba98-d40e927123ae tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.158191 Jan 11 04:04:42.943576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 452/918] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:42 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:43.034270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:43.034881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:43.046581 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.047094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.047835 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.048270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.199450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:43.200092 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:43.206109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.207695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.208119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.208477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.271858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:43.280546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:43.281560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:43.282943 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0d079c16-fc9e-4dbd-a746-b31983e2304c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.252707 Jan 11 04:04:43.286757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 467/919] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:43 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:43.291282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:43.292046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:43.298788 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.299246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.300169 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.300812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.381124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:43.388349 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8cba4c12-2b1c-48de-8a69-3afc8992e478 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1295 microversion: 2.1 time: 0.103326 Jan 11 04:04:43.388846 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 468/920] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:43 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:43.434171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:43.441923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c48fd146-b927-46b4-bf28-fbfd8cb544e7 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.245672 Jan 11 04:04:43.442480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 453/921] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:43 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:43.959933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:43.960473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:43.967244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.967963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:43.968957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:43.969409 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.239524 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.246902 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-94bb1902-3f13-42df-b137-87ca0aaff504 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.290719 Jan 11 04:04:44.247663 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 469/922] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:43 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:44.304199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:44.304817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:44.311115 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.311573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.312354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.312799 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.405812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:44.406600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:44.412893 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.413350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.414163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.414600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.574889 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.584391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.586496 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.594969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-be4a724f-2e6b-445a-9e6e-df83cfc20589 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.295212 Jan 11 04:04:44.595908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 454/923] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:44 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:04:44.602113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:44.602741 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:44.608742 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.609196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.610042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.610483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.711596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.719046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f5a179c2-c5a1-472c-9ce1-ba3a97f0ae67 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.317168 Jan 11 04:04:44.719625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 470/924] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:44 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:44.828504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:44.836407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ac7cea6b-79d1-47de-832c-dee2aee66da3 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.238606 Jan 11 04:04:44.837233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 455/925] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:44 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:44.912368 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-a2bcf2a7-b890-480a-b244-33b39b53d088 req-33c92b6c-e7d4-4d33-92bf-f524f4e7c1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed86684-13e9-4aea-aa35-5a71d7a0fb5d", "tag": "c9cdf5ad-a8e4-441a-a9bb-1e082d01458c"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:44.914431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:44.914431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:44.922628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a2bcf2a7-b890-480a-b244-33b39b53d088 req-33c92b6c-e7d4-4d33-92bf-f524f4e7c1e4 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.923890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a2bcf2a7-b890-480a-b244-33b39b53d088 req-33c92b6c-e7d4-4d33-92bf-f524f4e7c1e4 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:44.937435 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-a2bcf2a7-b890-480a-b244-33b39b53d088 req-33c92b6c-e7d4-4d33-92bf-f524f4e7c1e4 service nova] Creating event network-changed:c9cdf5ad-a8e4-441a-a9bb-1e082d01458c for instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d on hv-cinder-81977 Jan 11 04:04:44.951210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-a2bcf2a7-b890-480a-b244-33b39b53d088 req-33c92b6c-e7d4-4d33-92bf-f524f4e7c1e4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043943 Jan 11 04:04:44.952377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 471/926] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:44.986434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-2e1e16c8-a3a7-4bef-bf3e-de4017d2160d req-4e9f9a56-8ecb-4f6b-a684-d13ea1ad6988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6659a6a-85bb-40a8-aab4-4dcafd4c794b", "name": "network-vif-plugged", "status": "completed", "tag": "101914e4-0819-46d5-a457-be288226be76"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:44.990413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:44.990413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:04:44.997776 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-2e1e16c8-a3a7-4bef-bf3e-de4017d2160d req-4e9f9a56-8ecb-4f6b-a684-d13ea1ad6988 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:44.998224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-2e1e16c8-a3a7-4bef-bf3e-de4017d2160d req-4e9f9a56-8ecb-4f6b-a684-d13ea1ad6988 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.016859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-2e1e16c8-a3a7-4bef-bf3e-de4017d2160d req-4e9f9a56-8ecb-4f6b-a684-d13ea1ad6988 service nova] Creating event network-vif-plugged:101914e4-0819-46d5-a457-be288226be76 for instance d6659a6a-85bb-40a8-aab4-4dcafd4c794b on hv-cinder-81977 Jan 11 04:04:45.023587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-2e1e16c8-a3a7-4bef-bf3e-de4017d2160d req-4e9f9a56-8ecb-4f6b-a684-d13ea1ad6988 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044645 Jan 11 04:04:45.025040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 456/927] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:45.264911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:45.265622 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:45.271765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.272220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.273009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.273451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.458854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:45.466157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6e9d5579-abd4-4d48-940e-66fc3b6989c7 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.205626 Jan 11 04:04:45.466720 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 472/928] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:45 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:45.614607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:45.615295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:45.621786 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.622253 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.623019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.623447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.735726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:45.736346 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:45.742772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.743231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.744018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.744462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.753580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:45.761242 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:45.762757 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:45.763909 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-67dc578b-bd24-4770-ab20-1d04e6ab73fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.154004 Jan 11 04:04:45.764469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 457/929] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:45 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:45.852667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:45.853279 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:45.859060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.859506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.860298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:45.860738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:45.966355 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:45.976292 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-20537e3c-2308-4902-a6ae-3113867c29ab tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.244152 Jan 11 04:04:45.976859 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 473/930] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:45 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:46.025205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:46.032678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c4131226-70fc-4128-b66a-15442d4ed279 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.183760 Jan 11 04:04:46.033232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 458/931] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:45 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:46.483106 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:46.483704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:46.490054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:46.490504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:46.491285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:46.491718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:46.622261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:46.630115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e35004ab-0575-4f1d-ae8f-0bce4c084617 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.150675 Jan 11 04:04:46.630683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 474/932] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:46 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:46.781946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:46.782471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:46.788761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:46.789211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:46.790042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:46.790479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:46.925070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:46.933519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:46.935054 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:46.936214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8f8cb5df-8da8-4d6d-a295-bb770c380e91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.158304 Jan 11 04:04:46.936771 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 459/933] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:46 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:46.993528 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:46.994188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:46.999940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.000399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.001215 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.001657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.049149 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:47.049796 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:47.056222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.056681 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.057466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.057936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.169561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:47.177914 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-059d2eb4-38cd-46d4-93b3-8d1b9a71c172 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.188158 Jan 11 04:04:47.178498 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 475/934] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:46 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:47.212650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:47.219891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ae623902-ec70-414f-a415-ac9b78b77801 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1318 microversion: 2.1 time: 0.174387 Jan 11 04:04:47.220466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 460/935] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:47 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:47.646924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:47.647543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:47.653784 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.654238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.655022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.655710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.794154 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:47.801495 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1beec084-f2b9-4adc-adcc-90994547dba4 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.158715 Jan 11 04:04:47.802163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 476/936] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:47 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:47.953361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:47.953992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:47.960860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.961307 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:47.962118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:47.962555 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.087045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.094720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.096248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.097416 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4c837ea1-3778-48b9-b3d0-178dafb9c3e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.147753 Jan 11 04:04:48.098024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 461/937] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:47 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:48.195023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:48.195584 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:48.201426 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.201911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.202775 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.203209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.236082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:48.236693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:48.243186 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.243639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.244551 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.244864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.370375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.377873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-42236d58-8f5c-456c-9d8e-af7b42b75384 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.187008 Jan 11 04:04:48.378500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 477/938] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:48 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:48.417561 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.424866 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6f52181a-92ca-4a80-a36b-f98c84dac8ce tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1507 microversion: 2.1 time: 0.192415 Jan 11 04:04:48.425922 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 462/939] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:48 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:48.441875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6ccafc8-5c5d-4bd5-8a4c-954b83f283b8", "device": "/dev/sdb"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:48.443446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:48.449191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.449588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.450411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.450852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.682072 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-357aac1b-cad2-4a7d-ae48-34041810fd96 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "POST /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244308 Jan 11 04:04:48.684395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 478/940] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:04:48 2022] POST /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:48.818007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:48.818647 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:48.824835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.825290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.828024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.828024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:48.958178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:48.966095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1dab5cb5-c2fc-4886-ae6c-9ef25f1db085 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.151673 Jan 11 04:04:48.966591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 463/941] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:48 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:48.980321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-15cad6ad-53d3-45e4-b70f-2a8b50d0799e req-f7b90c88-ed7b-4a2f-96b9-776ede803fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "name": "network-vif-plugged", "status": "completed", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:48.981935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:48.981935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:48.989734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-15cad6ad-53d3-45e4-b70f-2a8b50d0799e req-f7b90c88-ed7b-4a2f-96b9-776ede803fd6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:48.990186 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-15cad6ad-53d3-45e4-b70f-2a8b50d0799e req-f7b90c88-ed7b-4a2f-96b9-776ede803fd6 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.001165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-15cad6ad-53d3-45e4-b70f-2a8b50d0799e req-f7b90c88-ed7b-4a2f-96b9-776ede803fd6 service nova] Creating event network-vif-plugged:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:04:49.005876 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-15cad6ad-53d3-45e4-b70f-2a8b50d0799e req-f7b90c88-ed7b-4a2f-96b9-776ede803fd6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 Jan 11 04:04:49.006465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 479/942] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:49.115361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:49.115923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:49.121713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.122177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.122950 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.123383 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.257612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:49.265659 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:49.267190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:49.268345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7c6ce036-d0eb-4bf0-af50-7da2c6f8f339 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.156809 Jan 11 04:04:49.268905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 464/943] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:49 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:49.396436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:49.397139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:49.403315 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.403765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.404546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.404995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.533840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:49.541207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b5920539-4f43-4edd-ade5-6878e1fcebed tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.149844 Jan 11 04:04:49.541790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 480/944] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:49 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:49.983219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:49.983822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:49.990915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.991354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:49.992119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:49.992545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:50.119713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:50.126932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e4ea204f-9a13-4c79-84a3-c4f9f3723e9e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.147621 Jan 11 04:04:50.127514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 465/945] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:49 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:50.287452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:50.287987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:50.294285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:50.294741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:50.295564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:50.296021 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:50.423018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:50.431453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:50.432982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:50.434189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fcc8f3fd-333d-4bca-9177-b889a4df1199 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.151097 Jan 11 04:04:50.434748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 481/946] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:50 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:50.557154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:50.557792 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:50.563638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:50.564130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:50.564938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:50.565365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:50.692465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:50.699683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-77f16f39-b716-4121-acc5-86a537bac9e4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.146152 Jan 11 04:04:50.700243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 466/947] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:50 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:51.144061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:51.144643 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:51.150988 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.151437 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.152214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.152651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.280419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:51.288266 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2c4dbad2-110a-40cd-83c8-a4c8a86670e6 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1575 microversion: 2.1 time: 0.147896 Jan 11 04:04:51.288829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 482/948] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:51 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:51.452376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:51.453773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:51.461009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.461513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.462336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.462771 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.595285 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:51.603528 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:51.605023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:51.606196 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-26944cab-1d53-4f61-a4de-655539125295 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1743 microversion: 2.20 time: 0.157771 Jan 11 04:04:51.606761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 467/949] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:51 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:51.716520 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:51.717046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:51.722861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.723305 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.724086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:51.724520 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:51.849932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:51.857274 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c88be733-d113-4c80-8ea9-b171a430ff64 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.144454 Jan 11 04:04:51.857858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 483/950] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:51 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:52.305045 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:52.305606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:52.311468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.311920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:52.312694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.313133 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:52.442328 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:52.449563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-532d28f7-8e08-4c3c-ac33-51571fb9940a tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1562 microversion: 2.1 time: 0.148216 Jan 11 04:04:52.450155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 468/951] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:52 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:52.624128 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:52.624660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:52.631061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.631506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:52.632278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.632709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:52.755587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:52.763337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:52.764820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:52.766025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b259a224-6de5-4502-8669-2a643701bea2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1743 microversion: 2.20 time: 0.145628 Jan 11 04:04:52.766571 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 484/952] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:52 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1743 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:52.874364 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:52.874877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:52.880627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.881072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:52.881875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:52.882315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:53.014601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:53.022800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ce3a30e2-d02b-4dd4-ba47-76ad6963ffa6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.152669 Jan 11 04:04:53.023368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 469/953] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:52 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:53.784537 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:53.785068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:53.791360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:53.791806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:53.792576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:53.793008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:53.920523 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:53.928868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:53.930412 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:53.931560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6e7045fa-b64d-432b-8c0a-79daf48ee9e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1743 microversion: 2.20 time: 0.151102 Jan 11 04:04:53.932115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 485/954] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:53 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:54.039987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:54.040533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:54.046885 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:54.047340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:54.048113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:54.048548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:54.178629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:54.185760 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-908ebf42-e163-4a5c-b158-54bedce6ccf7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.149417 Jan 11 04:04:54.186321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 470/955] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:54 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:54.948334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:54.949063 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:54.955389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:54.955922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:54.956822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:54.957902 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:55.032104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-ea204427-3173-4c31-875e-2c55bb7f6a9c req-65fca0fd-db4b-4647-a697-d20ba1d92d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed86684-13e9-4aea-aa35-5a71d7a0fb5d", "name": "network-vif-plugged", "status": "completed", "tag": "c9cdf5ad-a8e4-441a-a9bb-1e082d01458c"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:55.038921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:55.038921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:04:55.048005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-ea204427-3173-4c31-875e-2c55bb7f6a9c req-65fca0fd-db4b-4647-a697-d20ba1d92d57 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:55.048542 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-ea204427-3173-4c31-875e-2c55bb7f6a9c req-65fca0fd-db4b-4647-a697-d20ba1d92d57 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:55.060129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-ea204427-3173-4c31-875e-2c55bb7f6a9c req-65fca0fd-db4b-4647-a697-d20ba1d92d57 service nova] Creating event network-vif-plugged:c9cdf5ad-a8e4-441a-a9bb-1e082d01458c for instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d on hv-cinder-81977 Jan 11 04:04:55.065057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-ea204427-3173-4c31-875e-2c55bb7f6a9c req-65fca0fd-db4b-4647-a697-d20ba1d92d57 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Jan 11 04:04:55.065899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 471/956] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:55.096199 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:55.104058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:55.105649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:55.106908 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2ac28065-3a3f-48e3-a248-257e0e496208 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1743 microversion: 2.20 time: 0.162277 Jan 11 04:04:55.118536 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 486/957] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:54 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:55.202773 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:55.203559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:55.210482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:55.211066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:55.211905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:55.212465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:55.397227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:55.404506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e1e5cc66-42a0-4cf9-bc5f-fb3f8267bf31 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.205912 Jan 11 04:04:55.405065 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 472/958] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:55 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:04:56.128251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:56.129732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:56.136603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:56.137096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:56.137894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:56.138677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:56.277052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:56.288661 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:56.290420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:56.291573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b29f9efc-65e4-4829-ad6d-dc20965253f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.168604 Jan 11 04:04:56.292124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 487/959] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:56 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:56.421789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:56.422413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:56.429283 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:56.429756 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:56.430544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:56.430981 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:56.561442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:56.569437 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cdf4c52e-3630-4ffd-b4c1-9410883fd157 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1363 microversion: 2.1 time: 0.151217 Jan 11 04:04:56.570069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 473/960] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:56 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:57.101713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-314f4390-398e-41e5-b922-eb6b3977b3f6 req-4c2e4b30-284b-42fd-a84d-b69a790b6549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "name": "network-vif-plugged", "status": "completed", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:57.109639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:57.109639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:57.118301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-314f4390-398e-41e5-b922-eb6b3977b3f6 req-4c2e4b30-284b-42fd-a84d-b69a790b6549 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.119268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-314f4390-398e-41e5-b922-eb6b3977b3f6 req-4c2e4b30-284b-42fd-a84d-b69a790b6549 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.131829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-314f4390-398e-41e5-b922-eb6b3977b3f6 req-4c2e4b30-284b-42fd-a84d-b69a790b6549 service nova] Creating event network-vif-plugged:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:04:57.137723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-314f4390-398e-41e5-b922-eb6b3977b3f6 req-4c2e4b30-284b-42fd-a84d-b69a790b6549 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Jan 11 04:04:57.142886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 488/961] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:04:57.311358 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:57.312125 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:57.321468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.322334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.323431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.324350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.499616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:57.509997 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:57.511865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:57.513667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4f58c054-68af-496f-bb54-8c52d06a3d4d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.206764 Jan 11 04:04:57.514346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 474/962] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:57 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:57.587517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:57.588595 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:57.595676 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.596390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.597480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.598778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.736510 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:57.744614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-08ac2675-6cce-41a1-b10f-49f6df7057fe tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1549 microversion: 2.1 time: 0.161245 Jan 11 04:04:57.745283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 489/963] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:04:57 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:04:57.761650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:57.762155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:57.768371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.769019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.770595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:57.771210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:57.869336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8e4d9902-aeb4-45d3-953f-c6561e5b2080 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111272 Jan 11 04:04:57.875366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 475/964] 10.222.0.24 () {58 vars in 1274 bytes} [Tue Jan 11 04:04:57 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:58.532405 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:58.532941 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:58.539829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:58.540561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:58.541534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:58.542164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:58.782840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:58.792826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:58.795091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:04:58.796310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7bbc2a63-4570-493e-9871-ef29877dadbd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.267956 Jan 11 04:04:58.796872 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 490/965] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:58 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:04:59.268365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:59.269995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:59.270652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-4dd10639-ae3a-4da5-bc73-99865c96ab65 req-40bc2fdd-07bd-47d5-987b-a80e496ee28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed86684-13e9-4aea-aa35-5a71d7a0fb5d", "tag": "c9cdf5ad-a8e4-441a-a9bb-1e082d01458c"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:04:59.272270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:04:59.272270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:04:59.278067 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:59.278784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:59.279778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:59.280482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:59.282818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4dd10639-ae3a-4da5-bc73-99865c96ab65 req-40bc2fdd-07bd-47d5-987b-a80e496ee28e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:59.292139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4dd10639-ae3a-4da5-bc73-99865c96ab65 req-40bc2fdd-07bd-47d5-987b-a80e496ee28e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:59.304529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-4dd10639-ae3a-4da5-bc73-99865c96ab65 req-40bc2fdd-07bd-47d5-987b-a80e496ee28e service nova] Creating event network-changed:c9cdf5ad-a8e4-441a-a9bb-1e082d01458c for instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d on hv-cinder-81977 Jan 11 04:04:59.319108 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-4dd10639-ae3a-4da5-bc73-99865c96ab65 req-40bc2fdd-07bd-47d5-987b-a80e496ee28e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052089 Jan 11 04:04:59.319967 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 491/966] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:04:59.815963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:04:59.818401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:04:59.833572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:59.834237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:04:59.835246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:04:59.835840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:00.019063 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:00.029034 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:00.031134 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:00.032678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6f2b5b6f-9688-4e3e-b783-953a805b81df tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.221536 Jan 11 04:05:00.043783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 492/967] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:04:59 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:01.049965 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:01.050609 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:01.057490 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:01.058192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:01.059070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:01.059612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:01.213713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:01.225427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:01.227244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:01.228410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0fe7dd01-6d08-47ba-bb6c-c2f9d95afeb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.182279 Jan 11 04:05:01.229485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 493/968] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:01 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:01.586402 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-504caece-e698-4cf2-bf87-e397686c5a7f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 2.321974 Jan 11 04:05:01.588465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 476/969] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:04:59 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:02.248554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:02.249175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:02.256984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:02.257446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:02.258278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:02.258809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:02.417842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:02.428640 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:02.431185 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:02.432369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cb4cd4f1-8386-480d-9266-1b2623d60aed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.189605 Jan 11 04:05:02.443192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 494/970] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:02 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:02.599886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:02.600850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:02.611051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:02.611584 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:02.615457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:02.615915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:02.735603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f471d760-44a0-4541-9e85-5f0e4e00cdae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 0.139928 Jan 11 04:05:02.736523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 477/971] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:02 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:03.450621 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:03.451402 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:03.459293 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:03.459860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:03.460903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:03.461342 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:03.598894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:03.609236 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:03.610942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:03.612272 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-37a711c8-6be0-4ea5-828d-76e7b450b40c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.165323 Jan 11 04:05:03.612880 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 495/972] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:03 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:03.752106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:03.753142 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:03.766248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:03.767171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:03.768136 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:03.768734 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:04.632745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:04.633816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:04.640208 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:04.640686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:04.641481 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:04.641950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:04.805361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:04.814849 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:04.817434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:04.818830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-07918215-244a-4fbb-8f31-bfc1bd86f952 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.190256 Jan 11 04:05:04.819619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 496/973] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:04 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:05.836436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:05.837202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:05.844256 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:05.844710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:05.845488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:05.846192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:05.990615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:05.998899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:06.000500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:06.001706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-24a80269-a02c-4b26-8e4a-68fb69fd4718 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.169303 Jan 11 04:05:06.012529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 497/974] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:05 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:06.662978 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3d2fc09a-0e91-487e-99fa-6f887c58060f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 2.917366 Jan 11 04:05:06.663727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 478/975] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:03 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 2920 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:07.019635 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:07.020244 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:07.026583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:07.027030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:07.027808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:07.028243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:07.153439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:07.161265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:07.162795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:07.163933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-aae3c6e5-c584-4a91-a5ad-25bd113049b1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1738 microversion: 2.20 time: 0.147995 Jan 11 04:05:07.164486 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 498/976] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:07 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:07.673883 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:07.674917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:07.682973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:07.683424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:07.684209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:07.684644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:07.823033 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7b6469c7-732e-4be2-89db-8fd68a991e86 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 0.153004 Jan 11 04:05:07.823667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 479/977] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:07 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:08.181781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:08.182377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:08.188897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:08.189349 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:08.190189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:08.190629 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:08.349940 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:08.357710 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:08.359235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:08.360414 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2f643fd7-3c46-4da1-ad26-9fe4f70a9e73 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1720 microversion: 2.20 time: 0.182469 Jan 11 04:05:08.360984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 499/978] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:08 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:08.834524 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:08.835522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:08.842286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:08.842781 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:08.843585 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:08.844020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:09.000467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f8d8ace4-befb-4390-8c56-f05d77e1dd61 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 0.169815 Jan 11 04:05:09.001346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 480/979] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:08 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:09.378607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:09.379214 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:09.385421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:09.385899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:09.386674 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:09.387108 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:09.513542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:09.522698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:09.524452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:09.525803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-71dee8c6-2c73-4615-8a40-1c699da0462d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1720 microversion: 2.20 time: 0.150785 Jan 11 04:05:09.526353 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 500/980] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:09 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:10.011903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:10.012832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:10.019710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:10.020158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:10.020964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:10.021396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:10.121151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-619b7bbb-1aab-4c3d-a824-1a742853bfc1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 0.113173 Jan 11 04:05:10.122133 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 481/981] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:10 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:10.544167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:10.544822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:10.551671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:10.552117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:10.552891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:10.553324 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:10.690258 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:10.698050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:10.699549 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:10.700700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-db77892f-9dc3-42ea-a8ff-dc66e4c585f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1720 microversion: 2.20 time: 0.160255 Jan 11 04:05:10.701261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 501/982] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:10 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:11.048034 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-23a5ff05-9800-466e-9344-25e65a575445 req-c42650f0-069f-4733-8a92-1887facfc8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "name": "network-vif-unplugged", "status": "completed", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:11.049519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:05:11.049519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:05:11.057612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-23a5ff05-9800-466e-9344-25e65a575445 req-c42650f0-069f-4733-8a92-1887facfc8f7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.058086 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-23a5ff05-9800-466e-9344-25e65a575445 req-c42650f0-069f-4733-8a92-1887facfc8f7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.070913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-23a5ff05-9800-466e-9344-25e65a575445 req-c42650f0-069f-4733-8a92-1887facfc8f7 service nova] Creating event network-vif-unplugged:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:05:11.075574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-23a5ff05-9800-466e-9344-25e65a575445 req-c42650f0-069f-4733-8a92-1887facfc8f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031625 Jan 11 04:05:11.076178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 482/983] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:05:11.131931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:11.132884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:11.138982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.139438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.140403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.140647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.158852 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:11.159531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:11.165548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.166094 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.166941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.167448 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.240191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-389a8e07-4b1d-4cf9-998e-0bc0c9766801 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 14 microversion: 2.1 time: 0.112216 Jan 11 04:05:11.241009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 502/984] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:11 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:05:11.242551 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'services' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:11.309559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c3d2b024-7348-42ed-bb28-11c66da2c56b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b/os-volume_attachments/d6ccafc8-5c5d-4bd5-8a4c-954b83f283b8" status: 202 len: 0 microversion: 2.1 time: 0.155397 Jan 11 04:05:11.310380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 483/985] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:05:11 2022] DELETE /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b/os-volume_attachments/d6ccafc8-5c5d-4bd5-8a4c-954b83f283b8 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:05:11.719051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:11.719672 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:11.726472 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.726923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.727701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.728156 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.857564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:11.866319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:11.867824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:11.868971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-db849c36-c663-48a7-a4bd-c77e99c07198 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1663 microversion: 2.20 time: 0.154100 Jan 11 04:05:11.869518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 503/986] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:11 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:11.887009 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04eef6bc-84a7-4894-a731-4682364c135e"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:11.888189 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:11.894185 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.894638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:11.895417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:11.895857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.159234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-159c12ba-837d-47d9-b1d9-54053cacf4f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.276698 Jan 11 04:05:12.160468 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 484/987] 10.222.0.24 () {62 vars in 1363 bytes} [Tue Jan 11 04:05:11 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:12.251044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:12.251959 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:12.268380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.269057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.270429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.270868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.273890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:12.274498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:12.281028 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.281477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.282277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.282759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.372093 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7ecd9c26-f3ae-4d19-bfc8-99c1e808064f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 7815 microversion: 2.1 time: 0.124455 Jan 11 04:05:12.372823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 504/988] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:12 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 7815 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:05:12.416393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:12.420615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:12.423417 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-59a35fd2-1436-4ae5-b0f7-aece1c665f9f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action" status: 202 len: 0 microversion: 2.20 time: 0.155280 Jan 11 04:05:12.424010 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.427851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 485/989] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:05:12 2022] POST /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 11 04:05:12.428060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.428060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.428060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.435470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:12.436225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:12.443057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.443504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.444286 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.444725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.452375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:05:12.540912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4feafe56-b703-4ebc-8ab6-a1762907339f tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 204 len: 0 microversion: 2.1 time: 0.127938 Jan 11 04:05:12.541757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 505/990] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:05:12 2022] DELETE /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 11 04:05:12.550284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:12.551165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:12.557540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.558031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.558814 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:12.559252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:12.586523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:12.595143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:12.596646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:12.598431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cf132845-8ef9-4dea-b58f-8b2dc7be8b8d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1749 microversion: 2.20 time: 0.168077 Jan 11 04:05:12.598992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 486/991] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:12 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:12.690754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:12.698506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1add8415-8861-480b-9ec0-b00dc52b2309 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1513 microversion: 2.1 time: 0.152163 Jan 11 04:05:12.699071 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 506/992] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:12 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:05:13.382839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:13.383955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:13.390104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.390553 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.391332 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.391768 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.516334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-381387a9-f6d3-4ae5-aec0-f45e138826b8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 15025 microversion: 2.1 time: 0.136884 Jan 11 04:05:13.517199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 487/993] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:13 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 15025 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:13.616934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:13.617462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:13.623627 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.624076 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.624850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.625296 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.716271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:13.717093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:13.724360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.724823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.725620 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:13.726079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:13.749461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:13.757727 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:13.759227 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:13.760677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ddea6c40-b25b-4bb8-872b-d44bdd7ba6b6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1751 microversion: 2.20 time: 0.147966 Jan 11 04:05:13.761593 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 507/994] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:13 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:13.856813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:13.864408 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-016bf6f0-937d-48ac-a85b-ad9be13ae979 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1513 microversion: 2.1 time: 0.152074 Jan 11 04:05:13.864973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 488/995] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:13 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:14.527818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:14.528713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:14.535243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.535700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:14.536484 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.536926 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:14.716725 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-89fbb691-3bd8-4e2b-a343-326838a34373 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 17984 microversion: 2.1 time: 0.192499 Jan 11 04:05:14.717413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 508/996] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:14 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 17984 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:14.780057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:14.780827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:14.787144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.787598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:14.788379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.788823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:14.881101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:14.881708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:14.889147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.889591 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:14.890425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:14.890866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:15.165519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:15.173201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5b7b3b7c-6283-4345-8735-d6a8e2c21f68 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1513 microversion: 2.1 time: 0.296360 Jan 11 04:05:15.173805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 509/997] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:14 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:15.218182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:15.226443 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:15.228020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:15.229655 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c2138f16-e3d1-42e3-a3d6-a81d2b5b13d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.452899 Jan 11 04:05:15.232127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 489/998] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:14 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:15.728653 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:15.729572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:15.736400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:15.736855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:15.737850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:15.738292 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:15.840881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-df728c19-aa68-4b00-b728-da200378115f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 19024 microversion: 2.1 time: 0.115697 Jan 11 04:05:15.841528 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 510/999] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:15 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 19024 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:16.136255 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-34668ba3-2d18-4398-9dd2-f867b8dbc423 req-f4a2ddf8-5a71-4658-8b22-50bdf5ad3125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6659a6a-85bb-40a8-aab4-4dcafd4c794b", "name": "network-vif-deleted", "tag": "101914e4-0819-46d5-a457-be288226be76"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:16.137970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:05:16.137970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:05:16.146578 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-34668ba3-2d18-4398-9dd2-f867b8dbc423 req-f4a2ddf8-5a71-4658-8b22-50bdf5ad3125 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.147026 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-34668ba3-2d18-4398-9dd2-f867b8dbc423 req-f4a2ddf8-5a71-4658-8b22-50bdf5ad3125 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.158896 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-34668ba3-2d18-4398-9dd2-f867b8dbc423 req-f4a2ddf8-5a71-4658-8b22-50bdf5ad3125 service nova] Creating event network-vif-deleted:101914e4-0819-46d5-a457-be288226be76 for instance d6659a6a-85bb-40a8-aab4-4dcafd4c794b on hv-cinder-81977 Jan 11 04:05:16.163683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-34668ba3-2d18-4398-9dd2-f867b8dbc423 req-f4a2ddf8-5a71-4658-8b22-50bdf5ad3125 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Jan 11 04:05:16.164275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 490/1000] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:05:16.190915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:16.192525 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:16.199775 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.200219 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.200999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.201434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.249217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:16.250064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:16.256926 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.257497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.258433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.258977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.265561 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:16.275920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eba273e2-0b96-49ad-a8c6-b819285bfc42 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1303 microversion: 2.1 time: 0.089420 Jan 11 04:05:16.276821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 511/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:16 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:05:16.394274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:16.402616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:16.404133 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:16.405545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-58f6f1da-46b8-40c9-a8e1-ac6102e3647d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.160134 Jan 11 04:05:16.406134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 491/1002] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:16 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:16.852337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:16.853326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:16.860509 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.861103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:16.861983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:16.862428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.292132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:17.292767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:17.298998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:17.299447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.300236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:17.300672 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.334998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:17.335478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.336129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:17.374337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:17.383281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e8393114-4bfb-40a7-942a-99597ea47575 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.094774 Jan 11 04:05:17.384029 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 492/1003] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:17 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:17.424163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:17.424779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:17.431656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:17.432403 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.433381 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:17.433851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:17.570000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:17.578811 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:17.580311 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:17.581482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9b674a87-ed6b-4f63-88cd-cf1644337cb8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.161275 Jan 11 04:05:17.582076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 493/1004] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:17 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:18.400401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:18.401080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:18.407728 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:18.408177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:18.408966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:18.409403 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:18.441885 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:18.442336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:18.442791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:18.482143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:18.490777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-deb820f6-7f33-40e9-b9ee-db9034802ca1 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.093933 Jan 11 04:05:18.491484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 494/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:18 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:18.607293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:18.607906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:18.614106 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:18.614566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:18.615379 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:18.615807 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:18.757322 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:18.766095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:18.767605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:18.768779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-719637ba-22ff-4d40-91f0-db1d8da5c616 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.169529 Jan 11 04:05:18.769349 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 495/1006] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:18 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:19.507490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:19.508239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:19.514742 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:19.515340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:19.516147 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:19.516741 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:19.549302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:19.549894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:19.550362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:19.589507 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:19.596853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-10d84aed-49ed-414d-8626-ac72eb4f526a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.093130 Jan 11 04:05:19.597607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 496/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:19 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:19.787128 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:19.787659 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:19.793929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:19.794386 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:19.795183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:19.795625 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:19.930923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:19.939337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:19.940827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:19.942010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-114374ae-d00f-444d-8bf7-e3d49de0842d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.159209 Jan 11 04:05:19.942562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 497/1008] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:19 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:20.613490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:20.614662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:20.621103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:20.621554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:20.622369 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:20.622807 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:20.654208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:20.654654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:20.655107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:20.698708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:20.705975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-affe705b-948e-4103-b9b1-24a6b3347115 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.096176 Jan 11 04:05:20.706742 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 498/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:20 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:20.960736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:20.961482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:20.967541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:20.968226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:20.969201 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:20.969732 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:21.108502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:21.118409 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:21.119958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:21.121169 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6b5580c6-ede7-4438-9059-9e85e391071f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.164786 Jan 11 04:05:21.121904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 499/1010] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:20 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:21.722944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:21.723609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:21.730161 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:21.730498 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:21.731293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:21.731731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:21.763869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:21.764315 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:21.764769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:21.803903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:21.811422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0f725de3-f354-440b-aef4-5fea08f67345 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.092144 Jan 11 04:05:21.811985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 500/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:21 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:22.142073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:22.145160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:22.156456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:22.156947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:22.160644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:22.173175 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:22.335300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:22.344492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:22.346060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:22.347228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1f145551-4469-4ecc-a21f-638f245bb6d7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.211176 Jan 11 04:05:22.347785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 501/1012] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:22 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:22.828264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:22.829084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:22.835973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:22.836538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:22.837419 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:22.837968 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:22.870075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:22.870645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:22.871330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:22.920062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:22.927523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-377b5a6b-d3f3-47f7-82cf-c864dce411c4 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.102957 Jan 11 04:05:22.928277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 502/1013] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:22 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:23.366067 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:23.366677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:23.372693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:23.373144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:23.374091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:23.374404 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:23.511726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:23.520549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:23.522075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:23.523248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-27caf2d6-927e-4ea3-bd2a-9069186e6933 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.160915 Jan 11 04:05:23.523800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 503/1014] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:23 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:23.944104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:23.944799 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:23.951476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:23.951927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:23.952726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:23.953163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:23.985936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:23.986387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:23.986841 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:24.025833 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:24.033617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c4d2e58a-b0e9-44b0-b668-72f5b53dcd89 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.093208 Jan 11 04:05:24.034232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 504/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:23 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:05:24.542915 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:24.543523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:24.551103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:24.551820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:24.552727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:24.553158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:24.691503 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:24.701117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:24.702684 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:24.703845 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-face2f07-5c5e-41ba-8913-4c90b9096d0b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.164945 Jan 11 04:05:24.704401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 505/1016] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:24 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:25.050909 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:25.052183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:25.058395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:25.059031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:25.059790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:25.060226 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:25.093234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:25.093715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:25.094177 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:25.133273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:25.140821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-93155d56-3e7b-406c-9b51-d05404433327 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.093723 Jan 11 04:05:25.141386 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 506/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:25 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:25.722076 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:25.722681 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:25.729466 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:25.729952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:25.730747 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:25.731188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:25.859085 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:25.867764 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:25.869273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:25.870458 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8da055f2-8cd0-4784-8ef1-8a5fc2412a3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.152059 Jan 11 04:05:25.871061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 507/1018] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:25 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:26.158074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:26.158692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:26.165494 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:26.165976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:26.166762 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:26.167202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:26.196808 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:26.197258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:26.197765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:26.235180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:26.242920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b4f4d0c6-5464-4819-8e97-fa58fa3cf46a tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.088761 Jan 11 04:05:26.243475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 508/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:26 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:26.888127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:26.888738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:26.895536 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:26.895990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:26.896783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:26.897220 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:27.024914 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:27.033281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:27.034816 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:27.035964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6278ce19-f524-4e0d-9c8e-2e1994e7c2e3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.151576 Jan 11 04:05:27.036522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 509/1020] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:26 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:27.259579 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:27.260190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:27.266333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:27.266784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:27.267559 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:27.267999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:27.297107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:27.297556 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:27.298033 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:27.335875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:27.342977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-880a6f80-2d21-44ee-9a3b-37acfcae69fe tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.087072 Jan 11 04:05:27.343533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 510/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:27 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:28.053582 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:28.054217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:28.060074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:28.060518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:28.061290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:28.061745 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:28.187548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:28.196273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:28.197797 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:28.198938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-59a64ef3-7d70-4240-83c4-02aeb58a54c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.149078 Jan 11 04:05:28.199489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 511/1022] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:28 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:28.358612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:28.359246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:28.366063 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:28.366520 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:28.367308 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:28.367749 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:28.397897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:28.398352 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:28.398801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:28.439996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:28.447298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1ff2c60a-2cf2-432b-840a-908cb642047b tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.092294 Jan 11 04:05:28.447865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 512/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:28 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:29.216511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:29.217040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:29.222944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:29.223392 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:29.224167 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:29.224602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:29.348418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:29.356448 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:29.357952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:29.359085 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d6267870-b94c-4523-9c5f-d07071a6f2b4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.146384 Jan 11 04:05:29.359623 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 513/1024] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:29 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:29.463627 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:29.464227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:29.470333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:29.470722 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:29.471494 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:29.471932 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:29.501060 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:29.501504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:29.501985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lazy-loading 'fault' on Instance uuid d6659a6a-85bb-40a8-aab4-4dcafd4c794b {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:05:29.539738 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a459d3c9943f4c0281113828efc00dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bd43d3da6249f69f1a238934aae277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:29.546919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-52a43c83-b21f-43be-8312-8ff500171912 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 200 len: 1308 microversion: 2.1 time: 0.086708 Jan 11 04:05:29.547476 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 514/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:29 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:05:29.775619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4f9f0f64-4952-4f2e-9543-a889c683d61d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 12.927450 Jan 11 04:05:29.776200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 512/1026] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:16 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 12929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:30.376095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:30.376629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:30.382549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.382995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.383770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.384208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.514685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:30.523504 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:30.525004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:30.526192 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c1b1b9cf-be36-4849-a294-501f93043c03 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.153855 Jan 11 04:05:30.526744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 515/1027] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:30 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:30.564177 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:30.564873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] [instance: d6659a6a-85bb-40a8-aab4-4dcafd4c794b] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:30.572221 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.572671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.573448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.573930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.588158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] HTTP exception thrown: Instance d6659a6a-85bb-40a8-aab4-4dcafd4c794b could not be found. Jan 11 04:05:30.588726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] Returning 404 to user: Instance d6659a6a-85bb-40a8-aab4-4dcafd4c794b could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:05:30.589532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d0718112-9a61-4284-86de-61b723213f20 tempest-VolumesSnapshotTestJSON-680350528 tempest-VolumesSnapshotTestJSON-680350528-project] 10.222.0.24 "GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b" status: 404 len: 111 microversion: 2.1 time: 0.029367 Jan 11 04:05:30.590081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 513/1028] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:05:30 2022] GET /compute/v2.1/servers/d6659a6a-85bb-40a8-aab4-4dcafd4c794b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:05:30.787806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:30.789130 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:30.796551 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.797769 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.799160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:30.799831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:30.890097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-29abb66c-7f7f-48f3-ac24-5d356dfae390 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.105869 Jan 11 04:05:30.893871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 516/1029] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:30 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:31.544821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:31.545417 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:31.552714 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:31.553159 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:31.553958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:31.554393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:31.685203 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:31.693487 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:31.695015 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:31.696168 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-39da0cd5-78aa-45b9-9314-157db00876ed tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.155076 Jan 11 04:05:31.696722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 514/1030] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:31 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:31.901967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:31.902966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:31.910188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:31.911180 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:31.911969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:31.912406 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:31.998704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cbc4bf97-2551-4967-b6c8-1d32f9e4c7f6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.100504 Jan 11 04:05:31.999356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 517/1031] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:31 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:32.713488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:32.714114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:32.720371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:32.720816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:32.721580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:32.722060 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:32.850740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:32.858921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:32.860420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:32.861597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3c9a590e-ab5a-42a7-b456-605b92ac96a5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.151834 Jan 11 04:05:32.862201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 515/1032] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:32 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:33.010803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:33.011803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:33.018645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:33.019093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:33.019903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:33.020341 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:33.880494 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:33.881090 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:33.887483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:33.887927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:33.888697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:33.889126 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:34.019108 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:34.027239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:34.028721 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:34.029894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a8e5df6b-86b6-40ef-9b65-63d346b98360 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.153611 Jan 11 04:05:34.030696 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 516/1033] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:33 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:35.047726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:35.048985 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:35.055202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:35.055647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:35.056418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:35.056856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:35.183697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:35.192254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:35.193782 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:35.196023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-eb88092d-1946-4498-b793-18957ee7e443 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.151724 Jan 11 04:05:35.196682 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 517/1034] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:35 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:35.796059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bbe188b2-dbd6-47fa-9551-1b8cec0d2574 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 2.789044 Jan 11 04:05:35.796711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 518/1035] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:33 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 2791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:36.213983 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:36.214587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:36.220821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:36.221270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:36.222069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:36.223164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:36.432598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:36.440808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:36.442469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:36.443618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-486fb911-1cd3-476f-b45c-7a841a194ed6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.233467 Jan 11 04:05:36.444255 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 518/1036] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:36 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:36.807985 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:36.808976 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:36.817010 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:36.817482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:36.818294 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:36.818754 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:36.926084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d0f74c5b-b2d0-49c5-b7a3-270b449bb675 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.121920 Jan 11 04:05:36.927923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 519/1037] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:36 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:37.462488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:37.463097 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:37.470276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:37.470733 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:37.471533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:37.471977 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:37.600823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:37.609023 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:37.610570 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:37.611734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-82b2725f-7b8b-4876-ba71-b8b193126d37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.152879 Jan 11 04:05:37.612297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 519/1038] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:37 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:37.938098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:37.939089 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:37.946660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:37.947105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:37.947875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:37.948307 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:38.032209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2cf29292-e1c5-4f4b-9c5b-76774ed9e8a5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.098068 Jan 11 04:05:38.032857 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 520/1039] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:37 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:38.629304 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:38.629944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:38.636167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:38.636630 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:38.637448 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:38.637919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:38.768972 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:38.777589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:38.779116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:38.780277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9a4d1997-9cb5-49a3-807e-3ac4b22e3848 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.154721 Jan 11 04:05:38.781087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 520/1040] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:38 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:39.044254 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:39.045189 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:39.052141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:39.052702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:39.053599 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:39.054068 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:39.142378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6be48572-f907-4db0-99d1-dc8ac6f1b9ac tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.102000 Jan 11 04:05:39.143090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 521/1041] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:39 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:39.797942 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:39.798545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:39.805119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:39.805574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:39.806411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:39.806852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:39.957792 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:39.966830 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:39.968419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:39.969658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8868e66c-21ea-429e-b41a-c112e1547eb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.175415 Jan 11 04:05:39.970243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 521/1042] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:39 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:40.154345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:40.155395 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:40.163039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:40.163493 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:40.164273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:40.164710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:40.250418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-871f84e2-385f-4d4a-bef2-26ad24fe13cb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.100010 Jan 11 04:05:40.251058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 522/1043] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:40 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:40.987970 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:40.988672 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:40.994933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:40.995372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:40.996165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:40.996594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:41.144821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:41.156100 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:41.157899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:41.159068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-407eb74b-5a36-4b16-a42d-ebe289c139af tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.174862 Jan 11 04:05:41.159627 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 522/1044] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:40 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:41.263064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:41.264077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:41.270909 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:41.271362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:41.272160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:41.272603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:41.290898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-48493ffe-219d-443b-a534-02644cbc6881 req-45900815-8379-4283-9fc8-8cb23e9bc7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "name": "network-vif-plugged", "status": "completed", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:41.292416 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:05:41.292416 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:05:41.299173 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-48493ffe-219d-443b-a534-02644cbc6881 req-45900815-8379-4283-9fc8-8cb23e9bc7df service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:41.299628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-48493ffe-219d-443b-a534-02644cbc6881 req-45900815-8379-4283-9fc8-8cb23e9bc7df service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:41.311914 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-48493ffe-219d-443b-a534-02644cbc6881 req-45900815-8379-4283-9fc8-8cb23e9bc7df service nova] Creating event network-vif-plugged:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:05:41.316745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-48493ffe-219d-443b-a534-02644cbc6881 req-45900815-8379-4283-9fc8-8cb23e9bc7df service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029399 Jan 11 04:05:41.317329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 523/1045] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:05:41.404566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-816625f4-975c-4049-9dab-bd8ade5c3902 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.145547 Jan 11 04:05:41.409183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 523/1046] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:41 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 11 04:05:42.176953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:42.177592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:42.183598 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:42.184050 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:42.184832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:42.185278 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:42.314311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:42.322924 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:42.324408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:42.325553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-08ddd1db-e07d-4f35-9e6a-a3a5aaf3efb3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.153118 Jan 11 04:05:42.326132 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 524/1047] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:42 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:42.416719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:42.417743 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:42.424568 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:42.425019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:42.425830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:42.426267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:43.343652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:43.344251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:43.351145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:43.351588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:43.352351 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:43.352780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:43.476680 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:43.484773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:43.486303 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:43.487443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0fbdb9c1-4713-4a12-8652-60155139d7ce tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.147583 Jan 11 04:05:43.487989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 525/1048] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:43 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:44.505189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:44.505911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:44.511651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:44.512096 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:44.513053 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:44.513493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:44.643127 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:44.651327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:44.652822 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:44.653989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b8c25ee1-87d4-4699-b02c-1981ca64431d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.152557 Jan 11 04:05:44.654533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 526/1049] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:44 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:05:45.426354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-df0eeba0-9c4d-4f0d-8813-0f0a9e51a191 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 3.013427 Jan 11 04:05:45.426993 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 524/1050] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:42 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 3015 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:45.672166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:45.672888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:45.679773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:45.680216 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:45.680989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:45.681422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:45.809742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:45.817950 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:45.820036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:45.821186 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fcf05ff7-8060-4e4e-ae75-29c59f019573 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.152735 Jan 11 04:05:45.821757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 527/1051] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:45 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:46.438518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:46.439517 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:46.447211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:46.447664 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:46.448483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:46.448931 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:46.652246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8dad795c-0f44-42c1-9c77-96e42910a1cd tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.217537 Jan 11 04:05:46.652904 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 525/1052] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:46 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:46.839283 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:46.839903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:46.846147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:46.846603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:46.847390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:46.847832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:46.972870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:46.980881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:46.982410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:46.983558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b89451c6-457b-4ae6-ac7d-c080adde96cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.147968 Jan 11 04:05:46.984114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 528/1053] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:46 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:47.665040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:47.666228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:47.672896 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:47.673588 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:47.674882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:47.675388 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:47.764522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-39a15923-cbcb-4f4d-b2a5-c77fef76bedf tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.103785 Jan 11 04:05:47.765215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 526/1054] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:47 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:48.001209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:48.001856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:48.008231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:48.008682 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:48.009466 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:48.009927 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:48.141520 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:48.150229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:48.151726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:48.152879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f34af9f3-a75b-42dc-abdb-dbc5e72761fc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1807 microversion: 2.20 time: 0.155398 Jan 11 04:05:48.153430 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 529/1055] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:47 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:48.776541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:48.777545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:48.784715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:48.785170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:48.785989 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:48.786431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:48.886598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-69d3bce9-b247-4a42-8240-82e38ab78b1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.113867 Jan 11 04:05:48.887305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 527/1056] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:48 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:49.171337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:05:49.171981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:49.178328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:49.179303 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:49.180087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:49.180526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:49.314626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:49.322809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:49.324318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:05:49.325464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8c4f59bb-b830-4241-98f7-c282d11bd57c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1794 microversion: 2.20 time: 0.157892 Jan 11 04:05:49.326055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 530/1057] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:05:49 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1794 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:05:49.899445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:49.900450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:49.907591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:49.908044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:49.908845 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:49.909287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:50.007913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8eb7cae3-80f6-42ec-9f71-fd725bc8dc14 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.112864 Jan 11 04:05:50.008595 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 528/1058] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:49 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:51.019143 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:51.020062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:51.026366 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:51.026818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:51.027604 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:51.028044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:51.122773 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-def06f1d-bb7e-48a1-b05b-daff7fb81577 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28221 microversion: 2.1 time: 0.107077 Jan 11 04:05:51.123418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 531/1059] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:51 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:52.135000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:52.136084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:52.144681 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:52.145526 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:52.146366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:52.146793 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:52.249618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5335006c-e1a5-4fc2-b118-bcec59746ca9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28512 microversion: 2.1 time: 0.118942 Jan 11 04:05:52.250353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 529/1060] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:52 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28512 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:53.261515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:53.262587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:53.269516 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:53.270011 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:53.270790 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:53.271226 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:53.365227 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-05277b9d-d56b-4b0d-b0f5-4f32c3e8b0a3 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.108473 Jan 11 04:05:53.366586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 532/1061] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:53 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:54.378044 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:54.378997 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:54.386258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:54.386701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:54.387469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:54.388195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:54.475609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-098ec643-7c7c-4e80-adab-156f7fc81b12 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.101549 Jan 11 04:05:54.476287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 530/1062] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:54 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:55.487679 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:55.488684 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:55.495563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:55.496012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:55.496794 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:55.497239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:55.593767 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63299023-6774-4a11-9fa7-fd27bd323509 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.109986 Jan 11 04:05:55.594657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 533/1063] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:55 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:56.606264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:56.607470 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:56.614777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:56.615228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:56.616035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:56.616508 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:56.712597 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-511965c4-92ab-4bfd-b573-fd96104c80ba tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.110823 Jan 11 04:05:56.713248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 531/1064] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:56 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:57.724756 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:57.725783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:57.732572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:57.733025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:57.733848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:57.734292 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:57.835984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ee6ba480-d657-4396-a108-9857c91affd4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.115068 Jan 11 04:05:57.836646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 534/1065] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:57 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:58.848055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:58.849057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:58.856418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:58.856890 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:58.857697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:58.858138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:58.945785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-76fcad9f-e88e-46fe-8681-c18199659aee tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.101575 Jan 11 04:05:58.946427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 532/1066] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:58 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:05:59.956804 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:05:59.957818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:05:59.964609 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:59.965054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:05:59.965856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:05:59.966298 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:00.060806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2aed48e9-960c-4709-be42-8a4e2212e765 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.107884 Jan 11 04:06:00.061480 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 535/1067] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:05:59 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:01.073258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:01.074298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:01.081139 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:01.081587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:01.082389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:01.082825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:01.182919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5fcf1ffa-cbed-4ecb-9f5e-30ca746f67ef tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.113994 Jan 11 04:06:01.183457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 533/1068] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:01 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:02.194881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:02.196438 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:02.203389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:02.203845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:02.204633 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:02.205078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:02.293032 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6c6a9134-8f3e-4e5d-8fe1-096a072d171d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.102118 Jan 11 04:06:02.293718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 536/1069] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:02 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:03.305114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:03.306138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:03.312971 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:03.313421 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:03.314221 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:03.314663 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:03.414724 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f941b16f-506c-4dea-bd3c-f5e400b5a3d8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.113500 Jan 11 04:06:03.415348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 534/1070] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:03 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:04.426618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:04.427625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:04.434538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:04.434992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:04.435780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:04.436224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:04.520665 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e43cdded-d686-440f-a8c9-509858f458e2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.097946 Jan 11 04:06:04.521440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 537/1071] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:04 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:05.534158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:05.535081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:05.541983 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:05.542428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:05.543205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:05.543641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:05.635522 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5a0e379d-2669-4373-b00f-96231ea29ed8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.105657 Jan 11 04:06:05.636155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 535/1072] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:05 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:06.646771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:06.647770 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:06.655164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:06.655620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:06.656655 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:06.657092 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:06.745201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4e0ecf77-e068-4ab1-9de5-fbe10c396900 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.102284 Jan 11 04:06:06.745836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 538/1073] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:06 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:07.756955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:07.757901 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:07.764739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:07.765184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:07.766002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:07.766441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:07.852256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0113b132-c979-456d-b0eb-d49cc71794ae tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.098770 Jan 11 04:06:07.852894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 536/1074] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:07 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:08.864350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:08.865348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:08.872678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:08.873123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:08.873916 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:08.874350 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:08.974812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-091d5053-13d9-46de-ade7-3998b0347fb4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.114309 Jan 11 04:06:08.975475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 539/1075] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:08 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:09.987122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:09.988264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:09.995083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:09.995529 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:09.996305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:09.996737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:10.091563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2e5e9d62-57ae-4127-8394-a3b6437b02fc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.107942 Jan 11 04:06:10.092084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 537/1076] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:09 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:11.103923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:11.104928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:11.111873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:11.112329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:11.113120 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:11.113552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:11.199499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4347198a-9eb8-4570-a1f9-8de49ab34d1a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.100075 Jan 11 04:06:11.200051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 540/1077] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:11 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:12.211744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:12.212668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:12.219675 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:12.220117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:12.220894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:12.221324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:12.309346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a24c3606-21f4-46fd-81f2-84840cb1f606 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.101575 Jan 11 04:06:12.309999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 538/1078] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:12 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:13.321450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:13.322469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:13.329293 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:13.329772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:13.330552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:13.330992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:13.410719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-efbad26b-9254-46d9-a30c-d93a325ac165 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.093829 Jan 11 04:06:13.411327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 541/1079] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:13 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:14.422538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:14.423539 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:14.430467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:14.430916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:14.431694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:14.432129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:14.529597 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8a8189f6-0869-471c-8f53-4e7c7f8c2a92 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.110883 Jan 11 04:06:14.530265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 539/1080] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:14 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:15.542273 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:15.543309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:15.550177 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:15.550631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:15.551420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:15.551858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:15.644153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b1464cad-f7ba-49c7-ae49-536d70fc2544 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.106409 Jan 11 04:06:15.644769 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 542/1081] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:15 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:16.656422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:16.657422 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:16.664274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:16.664727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:16.666038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:16.666477 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:16.752865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c8f5be49-c89e-4caa-a5b9-8100939e3da9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.100575 Jan 11 04:06:16.753485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 540/1082] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:16 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:17.765356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:17.766425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:17.773272 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:17.773754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:17.774583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:17.775027 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:17.874199 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e8776ccd-9153-4503-ab12-cae0be86a9a8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.112695 Jan 11 04:06:17.875077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 543/1083] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:17 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:18.887310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:18.888297 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:18.895467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:18.895949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:18.896701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:18.897137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:18.980339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d2b68c8d-244a-4470-a81e-7f8959d2dcb8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.098080 Jan 11 04:06:18.981002 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 541/1084] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:18 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:19.992286 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:19.993309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:20.000152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:20.000600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:20.001378 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:20.001842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:20.090551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-88cad3b7-bd61-415c-b1f4-10704de876d9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 28680 microversion: 2.1 time: 0.101950 Jan 11 04:06:20.091173 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 544/1085] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:19 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 28680 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:21.102401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:21.103949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:21.110806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:21.111262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:21.112071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:21.112511 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:21.211789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d99610c5-1490-411f-a352-8675c78f4524 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 29768 microversion: 2.1 time: 0.113174 Jan 11 04:06:21.212344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 542/1086] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:21 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 29768 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:22.224658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:22.225597 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:22.232428 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:22.232884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:22.233694 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:22.234206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:22.337515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6b857235-a049-498a-840e-de1aa8b1b47d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 31881 microversion: 2.1 time: 0.117020 Jan 11 04:06:22.338176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 545/1087] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:22 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 31881 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:23.349431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:23.350469 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:23.357945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:23.358400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:23.359179 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:23.359617 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:23.457929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4dc03707-58cf-4b11-b2a2-c64e7a3aab3a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 33293 microversion: 2.1 time: 0.112422 Jan 11 04:06:23.458824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 543/1088] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:23 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 33293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:24.470726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:24.471732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:24.478653 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:24.479107 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:24.479892 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:24.480335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:24.575360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8dda1b8d-21bd-401b-95a2-67c120d0743f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 34274 microversion: 2.1 time: 0.108494 Jan 11 04:06:24.575992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 546/1089] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:24 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 34274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:25.588037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:25.589042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:25.595907 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:25.596361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:25.597143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:25.597583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:25.689290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e009277b-a0d3-4bb5-9a50-3d274caf7799 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 35519 microversion: 2.1 time: 0.105752 Jan 11 04:06:25.689992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 544/1090] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:25 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 35519 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:26.701040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:26.702067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:26.708904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:26.709358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:26.710174 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:26.710626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:26.802501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b9d88d34-ec77-4023-98d3-f3f5a4642df2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 37084 microversion: 2.1 time: 0.105388 Jan 11 04:06:26.803129 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 547/1091] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:26 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 37084 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:27.814260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:27.815259 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:27.822670 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:27.823123 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:27.823906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:27.824346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:27.912532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-82709336-6e04-46e3-b608-11f3a58abd11 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 38204 microversion: 2.1 time: 0.102220 Jan 11 04:06:27.913222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 545/1092] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:27 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 38204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:28.924857 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:28.925891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:28.932910 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:28.933363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:28.934177 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:28.934617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:29.027362 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0cc67441-1e14-4b84-86d5-a6030e78ca8d tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 38204 microversion: 2.1 time: 0.106448 Jan 11 04:06:29.027975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 548/1093] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:28 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 38204 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:30.040068 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:30.041064 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:30.047934 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:30.048378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:30.049155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:30.049587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:30.148040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-31cd5391-165d-489d-b3fd-9f3422b6ebeb tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 38204 microversion: 2.1 time: 0.111860 Jan 11 04:06:30.148686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 546/1094] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:30 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 38204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:31.160087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:31.161101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:31.168263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:31.168718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:31.169577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:31.169981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:31.264107 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8f9ebf6f-c77f-46bd-a354-3654d241690a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 38204 microversion: 2.1 time: 0.108150 Jan 11 04:06:31.265012 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 549/1095] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:31 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 38204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:32.275765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:32.276699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:32.283824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:32.284258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:32.285040 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:32.285479 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:32.381184 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a80d2dde-cc54-490c-a03b-567db105c757 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action" status: 200 len: 38335 microversion: 2.1 time: 0.109413 Jan 11 04:06:32.381858 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 547/1096] 10.222.0.24 () {60 vars in 1277 bytes} [Tue Jan 11 04:06:32 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/action => generated 38335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:32.391974 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:32.392551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:32.399323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:32.399768 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:32.400565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:32.400997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:32.424464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e4fc471e-5cdf-4013-aed8-8b417b9a300e tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/ips" status: 200 len: 146 microversion: 2.1 time: 0.036492 Jan 11 04:06:32.425009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 550/1097] 10.222.0.24 () {58 vars in 1247 bytes} [Tue Jan 11 04:06:32 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:33.721316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52971e89-4d28-45d5-acbb-32635623b906"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:33.722558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:33.729325 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:33.729815 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:33.730600 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:33.731042 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:33.978096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6f69a5f7-3ed0-4d76-938a-e47970b3af55 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260266 Jan 11 04:06:33.978694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 548/1098] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:06:33 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:41.409848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-0f26cc04-bbf3-4a05-8e34-37f8650c5740 req-1f121420-99ac-499c-972b-f50524a2cbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:41.411387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:06:41.411387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:06:41.417074 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:41.417618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:41.424948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.425401 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.429768 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-0f26cc04-bbf3-4a05-8e34-37f8650c5740 req-1f121420-99ac-499c-972b-f50524a2cbcc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.430294 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-0f26cc04-bbf3-4a05-8e34-37f8650c5740 req-1f121420-99ac-499c-972b-f50524a2cbcc service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.434453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.434905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.442143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-0f26cc04-bbf3-4a05-8e34-37f8650c5740 req-1f121420-99ac-499c-972b-f50524a2cbcc service nova] Creating event network-changed:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:06:41.447644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-0f26cc04-bbf3-4a05-8e34-37f8650c5740 req-1f121420-99ac-499c-972b-f50524a2cbcc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042157 Jan 11 04:06:41.448426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 549/1099] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:41.454648 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:41.455639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:41.461803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.462131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.462452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:06:41.462924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.463598 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.531849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-02859ebf-9054-4e51-85ae-656c5903aca6 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080839 Jan 11 04:06:41.537140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 550/1100] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:06:41 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:41.543203 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:41.543708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:41.546922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2556762f-de84-487a-86a5-81ffd2d17567 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "DELETE /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 204 len: 0 microversion: 2.1 time: 0.143507 Jan 11 04:06:41.547971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 551/1101] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:06:41 2022] DELETE /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:06:41.551862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.552977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.553881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.554550 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.562087 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:41.563007 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:41.569164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.569705 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.570850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:41.571650 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:41.585977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f0409890-2bac-477f-94da-f7a0ecdaf3f7 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906" status: 200 len: 194 microversion: 2.1 time: 0.047768 Jan 11 04:06:41.586801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 551/1102] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Jan 11 04:06:41 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:06:41.870519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:41.880386 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b5234695-68c7-4d5c-bc81-543acab5324e tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1568 microversion: 2.1 time: 0.326020 Jan 11 04:06:41.890922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 552/1103] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:41 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:06:42.897365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:42.898000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:42.904195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:42.904645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:42.905431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:42.906152 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:42.922867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4097f5ba-efe3-4146-b2e9-65f84335af42"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:42.923979 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:42.930873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:42.931338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:42.932136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:42.932580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:43.046438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:43.053652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-399d7ac4-c309-42d6-ac08-555bdadc5b76 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1449 microversion: 2.1 time: 0.160003 Jan 11 04:06:43.054237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 552/1104] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:42 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:43.217059 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b4193981-c90e-40fa-8122-81a9a1b3f1db tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297681 Jan 11 04:06:43.217707 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 553/1105] 10.222.0.24 () {60 vars in 1322 bytes} [Tue Jan 11 04:06:42 2022] POST /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:06:43.944661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-94c16773-d2b4-4150-8747-243d929e7704 req-d5ae897f-4d14-466b-a667-c9254e981df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cea542-b8d0-4bfc-a01f-ef913909d696", "name": "network-vif-deleted", "tag": "b464b027-72c9-4360-b788-188add334cc0"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:43.946761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:06:43.946761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:06:43.953939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-94c16773-d2b4-4150-8747-243d929e7704 req-d5ae897f-4d14-466b-a667-c9254e981df7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:43.954380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-94c16773-d2b4-4150-8747-243d929e7704 req-d5ae897f-4d14-466b-a667-c9254e981df7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:43.965702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-94c16773-d2b4-4150-8747-243d929e7704 req-d5ae897f-4d14-466b-a667-c9254e981df7 service nova] Creating event network-vif-deleted:b464b027-72c9-4360-b788-188add334cc0 for instance 13cea542-b8d0-4bfc-a01f-ef913909d696 on hv-cinder-81977 Jan 11 04:06:43.970682 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-94c16773-d2b4-4150-8747-243d929e7704 req-d5ae897f-4d14-466b-a667-c9254e981df7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029703 Jan 11 04:06:43.971245 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 553/1106] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:44.072332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:44.073039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:44.079071 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:44.079550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:44.080364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:44.080804 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:44.139338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a2cd37f07db460081345374727b0e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65441ebedff4d1eb294ecdd3dd8e56d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:44.146757 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-049234f9-941d-4429-9cbb-3bc2422ce445 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 200 len: 1219 microversion: 2.1 time: 0.079590 Jan 11 04:06:44.147314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 554/1107] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:44 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:45.164077 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:45.164821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] [instance: 13cea542-b8d0-4bfc-a01f-ef913909d696] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:45.170878 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.171330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.172114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.172549 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.185236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] HTTP exception thrown: Instance 13cea542-b8d0-4bfc-a01f-ef913909d696 could not be found. Jan 11 04:06:45.185846 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Returning 404 to user: Instance 13cea542-b8d0-4bfc-a01f-ef913909d696 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:06:45.186652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-492fbc8f-cbfd-42f1-be90-e7153a74394f tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696" status: 404 len: 111 microversion: 2.1 time: 0.027101 Jan 11 04:06:45.187163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 554/1108] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:45 2022] GET /compute/v2.1/servers/13cea542-b8d0-4bfc-a01f-ef913909d696 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:06:45.343831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6459811a-c6f7-45f4-87a1-00e0562026d0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] Calling method '.version_select at 0x7f4e6581f940>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:45.344254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:45.344796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:45.359235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.359747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.360559 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.361001 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.364440 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6459811a-c6f7-45f4-87a1-00e0562026d0 tempest-TestShelveInstance-1326008782 tempest-TestShelveInstance-1326008782-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-228509899" status: 202 len: 0 microversion: 2.1 time: 0.023640 Jan 11 04:06:45.365298 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 555/1109] 10.222.0.24 () {58 vars in 1250 bytes} [Tue Jan 11 04:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-228509899 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:06:45.404065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5324e8ba-543b-46c6-99e8-d1e31a968c50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments/04eef6bc-84a7-4894-a731-4682364c135e" status: 200 len: 194 microversion: 2.20 time: 0.066524 Jan 11 04:06:45.409873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 555/1110] 10.222.0.24 () {60 vars in 1453 bytes} [Tue Jan 11 04:06:45 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments/04eef6bc-84a7-4894-a731-4682364c135e => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:45.465432 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:45.465945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:45.471626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.472072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.472848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.473287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.553638 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.objects.instance [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lazy-loading 'services' on Instance uuid 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c {{(pid=116387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:06:45.621071 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e4daaa4e-ba94-4251-8130-b93159ae2f34 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments/04eef6bc-84a7-4894-a731-4682364c135e" status: 202 len: 0 microversion: 2.20 time: 0.159787 Jan 11 04:06:45.621656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 556/1111] 10.222.0.24 () {60 vars in 1456 bytes} [Tue Jan 11 04:06:45 2022] DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments/04eef6bc-84a7-4894-a731-4682364c135e => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:06:45.630465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:45.631385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:45.638813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.639276 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.640077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:45.640628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:45.670855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-619661fb-9c5c-4521-9ec4-6bfe74607807 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044017 Jan 11 04:06:45.671331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 556/1112] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:45 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:46.682989 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:46.684069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:46.690700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:46.691232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:46.692092 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:46.692602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:46.722232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9718c7e1-520a-4e76-aca8-6240c5bcca40 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043449 Jan 11 04:06:46.722804 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 557/1113] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:46 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:47.734049 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:47.734922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:47.741303 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:47.741777 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:47.743234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:47.743672 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:47.773722 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-2582489b-36c0-4651-80be-636312e9a263 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043566 Jan 11 04:06:47.774479 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 557/1114] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:47 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:48.784772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:48.785566 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:48.792643 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:48.793097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:48.793923 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:48.794361 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:48.823714 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b23633da-6cd0-4b3d-b947-025fd224e62e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043053 Jan 11 04:06:48.824268 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 558/1115] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:48 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:49.834930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:49.835867 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:49.843141 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:49.843590 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:49.844376 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:49.845234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:49.885909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-cfac6329-13af-47da-871f-2a99f1af9f3b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054741 Jan 11 04:06:49.886731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 558/1116] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:49 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:50.795898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:50.796820 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:50.804618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:50.806777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:50.807613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:50.808207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:50.842271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c5a9e2a0-33ae-4fd8-8573-569d3ff33cb9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051481 Jan 11 04:06:50.842910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 559/1117] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:06:50 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:50.896314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:50.897254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:50.904016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:50.904470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:50.905260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:50.905712 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:50.937396 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c3521dd3-fd63-444f-ba8a-2cc12d638294 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Jan 11 04:06:50.938318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 559/1118] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:50 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:06:51.304021 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:51.304518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:51.310456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.310914 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.311703 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.312134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.348167 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b84aebda-35b2-41ee-abdb-24c18cb47dc4 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906" status: 200 len: 194 microversion: 2.1 time: 0.047817 Jan 11 04:06:51.348761 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 560/1119] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Jan 11 04:06:51 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:51.358671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:51.359158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:51.365005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.365451 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.366249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.366683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.442310 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lazy-loading 'services' on Instance uuid 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:06:51.538024 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a38cb6c6-1698-4c71-8455-1ac44ebb7db8 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906" status: 202 len: 0 microversion: 2.1 time: 0.182356 Jan 11 04:06:51.542468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 560/1120] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:06:51 2022] DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/52971e89-4d28-45d5-acbb-32635623b906 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:06:51.949053 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:51.950024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:51.956120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.956576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.957372 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:51.957847 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:51.987287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-afb764bf-5744-4696-8833-a905d8d7aaf1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042708 Jan 11 04:06:51.987856 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 561/1121] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:06:51 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:52.048766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:52.049485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:52.056760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:52.057684 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:52.058490 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:52.059482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:52.089368 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:06:52.169339 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-219498d7-1bb1-4624-b06f-4818739d7518 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 204 len: 0 microversion: 2.20 time: 0.128403 Jan 11 04:06:52.170421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 561/1122] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Jan 11 04:06:52 2022] DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 04:06:52.181576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:52.182224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:52.190355 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:52.191035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:52.191843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:52.192350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:52.334373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:52.342309 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:52.343818 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:52.344973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fd57dd93-82f3-4348-8b0d-ea55552c5be5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.169922 Jan 11 04:06:52.345533 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 562/1123] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:06:52 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:06:53.364035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:53.364742 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:53.371554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.372006 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.372788 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.373229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.500999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:53.509372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:53.510925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:53.512084 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f5bb2dcc-96d5-4115-8782-ed6c0134f412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.152214 Jan 11 04:06:53.512646 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 562/1124] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:06:53 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:06:53.714949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:53.715441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:53.721543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.722024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.722797 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.723232 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.751509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-20f58ee7-ee62-49fe-a632-90aaeda39c52 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/4097f5ba-efe3-4146-b2e9-65f84335af42" status: 200 len: 194 microversion: 2.1 time: 0.040287 Jan 11 04:06:53.752066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 563/1125] 10.222.0.24 () {58 vars in 1412 bytes} [Tue Jan 11 04:06:53 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/4097f5ba-efe3-4146-b2e9-65f84335af42 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:53.761371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:53.761905 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:53.767730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.768182 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.768969 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:53.769411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:53.845695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lazy-loading 'services' on Instance uuid 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:06:53.911885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-67b7387b-6e0f-467a-9c0c-2800cde95441 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/4097f5ba-efe3-4146-b2e9-65f84335af42" status: 202 len: 0 microversion: 2.1 time: 0.154030 Jan 11 04:06:53.912499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 563/1126] 10.222.0.24 () {58 vars in 1415 bytes} [Tue Jan 11 04:06:53 2022] DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments/4097f5ba-efe3-4146-b2e9-65f84335af42 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:06:54.530300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:54.530837 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:54.536908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:54.537354 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:54.538168 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:54.538601 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:54.718151 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:54.727216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:54.729442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:54.730713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-17c1ab1a-3f5d-4999-be63-3ffe1bef19c4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 200 len: 1722 microversion: 2.20 time: 0.204478 Jan 11 04:06:54.731591 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 564/1127] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:06:54 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:06:55.047301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-15f2f037-1847-4350-8478-7ac487fe5b04 req-969c6327-6ac4-43a4-88ce-21b0813d1d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c", "name": "network-vif-deleted", "tag": "7c2fbab8-970c-4688-93d6-1178bfdfc0d2"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:55.049552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:06:55.049552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:06:55.061531 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-15f2f037-1847-4350-8478-7ac487fe5b04 req-969c6327-6ac4-43a4-88ce-21b0813d1d97 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.062530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-15f2f037-1847-4350-8478-7ac487fe5b04 req-969c6327-6ac4-43a4-88ce-21b0813d1d97 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.074062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.074563 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-15f2f037-1847-4350-8478-7ac487fe5b04 req-969c6327-6ac4-43a4-88ce-21b0813d1d97 service nova] Creating event network-vif-deleted:7c2fbab8-970c-4688-93d6-1178bfdfc0d2 for instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c on hv-cinder-81977 Jan 11 04:06:55.078305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:55.079517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-15f2f037-1847-4350-8478-7ac487fe5b04 req-969c6327-6ac4-43a4-88ce-21b0813d1d97 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036515 Jan 11 04:06:55.080285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 564/1128] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:55.088072 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.088527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.089346 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.090031 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.123394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2a43b96f-6554-46b2-8c29-042300c59160 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053551 Jan 11 04:06:55.124293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 565/1129] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:06:55 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:06:55.251526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.252583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:55.260055 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.260594 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.261509 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.262035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.294319 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-93168eb3-5da5-4436-bf59-ee38a30a501a tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046998 Jan 11 04:06:55.294975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 565/1130] 10.222.0.24 () {58 vars in 1301 bytes} [Tue Jan 11 04:06:55 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 11 04:06:55.349488 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.350011 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:55.355816 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.356212 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.356984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.357414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.380868 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:06:55.454693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-2057031d-133b-466c-aadb-b92923e5642f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 204 len: 0 microversion: 2.1 time: 0.108476 Jan 11 04:06:55.455611 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 566/1131] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:06:55 2022] DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:06:55.464110 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.464720 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:55.470677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.471331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.472119 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.472560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.610202 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:55.618855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f8120506-4d17-48e4-8561-95fa2e9addcc tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1674 microversion: 2.1 time: 0.158878 Jan 11 04:06:55.619523 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 566/1132] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:55 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:55.749481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.750240 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:55.756748 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.757202 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.758651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:55.759086 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:55.772866 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. Jan 11 04:06:55.773460 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:06:55.774308 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9bf8c04a-9d6f-40c2-ad3b-d16359bb2fcd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 404 len: 111 microversion: 2.20 time: 0.028949 Jan 11 04:06:55.774887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 567/1133] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:06:55 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:06:55.783620 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0042a632-c7ca-4f7f-b170-edf6f024a3db tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '.version_select at 0x7f4e65a554c0>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:55.802678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0042a632-c7ca-4f7f-b170-edf6f024a3db tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471692725" status: 204 len: 0 microversion: 2.20 time: 0.023223 Jan 11 04:06:55.803260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 567/1134] 10.222.0.24 () {60 vars in 1258 bytes} [Tue Jan 11 04:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471692725 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 11 04:06:56.636138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:56.636808 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:56.642810 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:56.643259 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:56.644036 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:56.644471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:56.720912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: .version_select at 0x7f4e65cb65e0>, body: {"keypair": {"name": "tempest-keypair-1597873558"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:56.738164 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:06:56.741986 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:06:56.780482 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:56.788174 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d4a515c5-a878-4267-be16-9af534fb8712 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1674 microversion: 2.1 time: 0.155737 Jan 11 04:06:56.788733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 568/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:56 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:57.026419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:06:57.030300 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:06:57.043395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c59e0095-b614-45d6-9f5e-9fea675ea74b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.326759 Jan 11 04:06:57.044005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 568/1136] 10.222.0.24 () {62 vars in 1198 bytes} [Tue Jan 11 04:06:56 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 328 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 11 04:06:57.805495 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:57.806302 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:57.813014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:57.813611 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:57.814587 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:57.815228 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:58.074242 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:58.082193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f6357b9f-a0b3-4578-868c-a2149eccef1f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1674 microversion: 2.1 time: 0.281321 Jan 11 04:06:58.093546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 569/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:57 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1674 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:06:58.306241 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-487873778", "imageRef": "b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fb11a25-fb24-411b-9039-109a92324917"}], "security_groups": [{"name": "tempest-securitygroup--558764120"}], "key_name": "tempest-keypair-1597873558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:58.473808 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] validate_networks() for [('2fb11a25-fb24-411b-9039-109a92324917', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:06:58.614471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-b3b582c4-2c7b-4d18-86cd-b96525ebc5e6 req-c1f876b8-61e7-4356-9198-8560af87a940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed86684-13e9-4aea-aa35-5a71d7a0fb5d", "name": "network-vif-deleted", "tag": "c9cdf5ad-a8e4-441a-a9bb-1e082d01458c"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:06:58.619902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:06:58.619902 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:06:58.637876 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-b3b582c4-2c7b-4d18-86cd-b96525ebc5e6 req-c1f876b8-61e7-4356-9198-8560af87a940 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:58.638756 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-b3b582c4-2c7b-4d18-86cd-b96525ebc5e6 req-c1f876b8-61e7-4356-9198-8560af87a940 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:58.660215 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-b3b582c4-2c7b-4d18-86cd-b96525ebc5e6 req-c1f876b8-61e7-4356-9198-8560af87a940 service nova] Creating event network-vif-deleted:c9cdf5ad-a8e4-441a-a9bb-1e082d01458c for instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d on hv-cinder-81977 Jan 11 04:06:58.667323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-b3b582c4-2c7b-4d18-86cd-b96525ebc5e6 req-c1f876b8-61e7-4356-9198-8560af87a940 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056235 Jan 11 04:06:58.669248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 570/1138] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:06:58.931904 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:06:58.932326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:06:58.932925 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:06:58.933337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:06:58.933772 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:06:58.942559 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:58.943091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:58.944020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:58.944530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:58.961848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:06:58.965855 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Getting quotas for user 2f4392e543394fb9ae2b6bb2a5810e6d and project 41ed38b3c7d84dab859ca3e64c19a348. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:06:58.977197 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:06:58.979651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b596615d-fbb1-4d4c-8a7b-b2c89d0a9b74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:06:59.024189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a4c04e60-f4df-4e60-8e76-bc9f64d29fe7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.721936 Jan 11 04:06:59.025011 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 569/1139] 10.222.0.24 () {62 vars in 1187 bytes} [Tue Jan 11 04:06:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 11 04:06:59.035491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:59.036295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:59.093091 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:59.102393 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:06:59.104647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:06:59.111813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:59.113834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:59.115224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c580d039-0c85-438b-be8a-3107318a6ccb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1281 microversion: 2.20 time: 0.084264 Jan 11 04:06:59.116127 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 571/1140] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:06:59 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:06:59.126328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:59.126328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:59.126328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:59.126328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:59.157994 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:06:59.158462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:06:59.159454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lazy-loading 'fault' on Instance uuid 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:06:59.206713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2162ca139f14ab0a7b9ae089ad4c6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f030f843e6c46e09c485209f0b2c0b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:06:59.222078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-98f9d149-cda9-4937-acfe-83c07da9e3d5 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 200 len: 1327 microversion: 2.1 time: 0.125569 Jan 11 04:06:59.223020 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 570/1141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:06:59 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:07:00.134219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:00.134855 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:00.142141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:00.142593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:00.143431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:00.143864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:00.210205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:00.218093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:00.219639 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:00.220759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-49cfd88c-f9b8-424a-8340-860c33bc44fa tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1339 microversion: 2.20 time: 0.090877 Jan 11 04:07:00.221293 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 572/1142] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:00 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:00.241067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:00.241824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:00.248697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:00.249227 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:00.250144 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:00.250656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:00.264064 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. Jan 11 04:07:00.264733 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:07:00.265652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0c304641-519a-4c62-9779-50208709c8c9 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 404 len: 111 microversion: 2.1 time: 0.029615 Jan 11 04:07:00.266210 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 571/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:07:00 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 04:07:00.274771 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6451e052-f472-4c27-8450-c1e76bfb17d1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '.version_select at 0x7f4e6581fca0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:00.292454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6451e052-f472-4c27-8450-c1e76bfb17d1 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646512566" status: 202 len: 0 microversion: 2.1 time: 0.021764 Jan 11 04:07:00.293024 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 573/1144] 10.222.0.24 () {58 vars in 1217 bytes} [Tue Jan 11 04:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646512566 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:01.241987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:01.246046 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:01.252882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:01.253332 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:01.254172 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:01.254607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:01.466433 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:01.475545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:01.477608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:01.478893 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c22ea794-84ee-479b-a4e3-66b3952e74dd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.244158 Jan 11 04:07:01.479443 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 572/1145] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:01 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:01.519892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-abfc64e4-b8e3-4acd-88b0-1f931ab0b014 req-d7372660-6aaa-41a5-8841-c1571baa7d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:01.521534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:07:01.521534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:07:01.535165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-abfc64e4-b8e3-4acd-88b0-1f931ab0b014 req-d7372660-6aaa-41a5-8841-c1571baa7d22 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:01.535677 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-abfc64e4-b8e3-4acd-88b0-1f931ab0b014 req-d7372660-6aaa-41a5-8841-c1571baa7d22 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:01.558819 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-abfc64e4-b8e3-4acd-88b0-1f931ab0b014 req-d7372660-6aaa-41a5-8841-c1571baa7d22 service nova] Creating event network-changed:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:07:01.564020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-abfc64e4-b8e3-4acd-88b0-1f931ab0b014 req-d7372660-6aaa-41a5-8841-c1571baa7d22 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047742 Jan 11 04:07:01.564839 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 574/1146] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:07:02.496844 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:02.497484 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:02.503949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:02.504399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:02.505368 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:02.505837 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:02.637356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:02.645288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:02.646939 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:02.648250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a2017499-cb5c-4298-9955-64586e9244b2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.155138 Jan 11 04:07:02.648919 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 573/1147] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:02 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:03.246162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:03.246749 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:03.252925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.253377 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.254178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.254616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.267352 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. Jan 11 04:07:03.267920 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:07:03.268717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9260ab36-044e-4cb7-a6f1-24fd467a3415 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027099 Jan 11 04:07:03.269269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 575/1148] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:07:03 2022] DELETE /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:07:03.277166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:03.277795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:03.283743 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.284196 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.284964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.285397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.298812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. Jan 11 04:07:03.299389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 2ed86684-13e9-4aea-aa35-5a71d7a0fb5d could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:07:03.300183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-adc007f7-5558-47e3-8616-1c68e75a5fc2 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027092 Jan 11 04:07:03.300683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 574/1149] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:07:03 2022] GET /compute/v2.1/servers/2ed86684-13e9-4aea-aa35-5a71d7a0fb5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:07:03.667148 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:03.667969 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:03.674990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.675702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.676694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:03.677222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:03.808803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:03.816304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:03.817843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:03.818934 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bd12ff4f-ca56-4182-a06e-83f61ea7969d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.156739 Jan 11 04:07:03.819481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 576/1150] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:03 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:04.420425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:04.420920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:04.427091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.427543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.428318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.428751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.442440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. Jan 11 04:07:04.443068 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:07:04.443866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-fc895b94-a5a3-4da3-b316-b5f102eff263 tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 404 len: 111 microversion: 2.1 time: 0.027063 Jan 11 04:07:04.444377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 575/1151] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:07:04 2022] DELETE /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:07:04.452038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:04.452654 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] [instance: 36cfea01-d609-4829-8083-058ca877eab5] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:04.458987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.459438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.460218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.460658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.473489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] HTTP exception thrown: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. Jan 11 04:07:04.474172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] Returning 404 to user: Instance 36cfea01-d609-4829-8083-058ca877eab5 could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:07:04.474973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-dcb4aa9c-be8d-4517-801b-b7a30f477f0f tempest-AttachVolumeTestJSON-110961035 tempest-AttachVolumeTestJSON-110961035-project] 10.222.0.24 "GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5" status: 404 len: 111 microversion: 2.1 time: 0.026644 Jan 11 04:07:04.475480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 577/1152] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:07:04 2022] GET /compute/v2.1/servers/36cfea01-d609-4829-8083-058ca877eab5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:07:04.836228 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:04.836984 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:04.842786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.843245 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.844028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:04.844465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:04.969953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:04.978113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:04.979631 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:04.980747 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-05b93109-b742-4952-98b5-90de3d314358 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.148300 Jan 11 04:07:04.981311 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 576/1153] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:04 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:07:05.998626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:05.999217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:06.004879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:06.005323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:06.006129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:06.006563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:06.152581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:06.168099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:06.169996 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:06.171296 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e4ff85e0-c83f-499a-b26a-7f929b6211f5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.176862 Jan 11 04:07:06.172465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 578/1154] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:05 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:07.190492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:07.191695 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:07.198565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:07.199019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:07.199870 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:07.200318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:07.403484 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:07.411333 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:07.412829 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:07.413953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-86d94a92-4936-4dd9-a770-6c650ec3a978 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.227617 Jan 11 04:07:07.414513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 577/1155] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:07 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:07.862887 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-ba258243-c197-48a3-8e9e-a894abd218f6 req-a92cc7cf-dc48-44e3-9da8-b7f2b8ca10cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "name": "network-vif-plugged", "status": "completed", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:07.864995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:07:07.864995 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:07:07.872810 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-ba258243-c197-48a3-8e9e-a894abd218f6 req-a92cc7cf-dc48-44e3-9da8-b7f2b8ca10cf service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:07.873316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-ba258243-c197-48a3-8e9e-a894abd218f6 req-a92cc7cf-dc48-44e3-9da8-b7f2b8ca10cf service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:07.891612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-ba258243-c197-48a3-8e9e-a894abd218f6 req-a92cc7cf-dc48-44e3-9da8-b7f2b8ca10cf service nova] Creating event network-vif-plugged:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:07:07.896731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-ba258243-c197-48a3-8e9e-a894abd218f6 req-a92cc7cf-dc48-44e3-9da8-b7f2b8ca10cf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037464 Jan 11 04:07:07.897943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 579/1156] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:07:08.431250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:08.431897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:08.438326 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:08.438783 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:08.439683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:08.439998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:08.574495 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:08.582334 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:08.583975 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:08.585197 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3eba3fe3-e415-4c04-9819-0d8a6b180262 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1406 microversion: 2.20 time: 0.157577 Jan 11 04:07:08.586406 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 578/1157] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:08 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:09.604701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:09.605435 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:09.612790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:09.613243 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:09.614124 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:09.614508 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:09.751453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:09.759931 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:09.761518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:07:09.762783 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-73209693-0bc1-4e34-9dd5-e87ae474ba59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1598 microversion: 2.20 time: 0.162688 Jan 11 04:07:09.763427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 580/1158] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:07:09 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:07:09.780464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:07:09.781037 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:09.787956 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:09.788348 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:09.789781 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:09.790380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:09.869270 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f721a552-a87d-4269-a594-d76951579916 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093238 Jan 11 04:07:09.869937 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 579/1159] 10.222.0.24 () {60 vars in 1315 bytes} [Tue Jan 11 04:07:09 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:07:11.025269 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:11.026277 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:11.028853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-1d886ac1-325f-4479-95ee-6e57af2ac4a4 req-0cb44a12-f230-450b-8ed0-6ff7fd68694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:11.031493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:07:11.031493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:07:11.032750 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:11.033205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:11.034096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:11.034898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:11.039431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1d886ac1-325f-4479-95ee-6e57af2ac4a4 req-0cb44a12-f230-450b-8ed0-6ff7fd68694a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:11.039431 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-1d886ac1-325f-4479-95ee-6e57af2ac4a4 req-0cb44a12-f230-450b-8ed0-6ff7fd68694a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:11.050744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-1d886ac1-325f-4479-95ee-6e57af2ac4a4 req-0cb44a12-f230-450b-8ed0-6ff7fd68694a service nova] Creating event network-changed:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:07:11.056346 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-1d886ac1-325f-4479-95ee-6e57af2ac4a4 req-0cb44a12-f230-450b-8ed0-6ff7fd68694a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Jan 11 04:07:11.056882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 580/1160] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:07:11.138101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a643f32a-d257-4ab0-8a91-992fe7d24e50 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 0.117706 Jan 11 04:07:11.139724 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 581/1161] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:11 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:12.149292 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:12.150343 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:12.156671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:12.157123 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:12.157930 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:12.158367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:14.576166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9c7334ca-6180-4924-abd6-41054f2cdcc4 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 2.431179 Jan 11 04:07:14.576852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 581/1162] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:12 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:15.586548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:15.587555 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:15.594392 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:15.594842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:15.595626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:15.596062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:15.674586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d8ab969a-ee68-49f6-8b7e-e848789157f3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 0.092117 Jan 11 04:07:15.675333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 582/1163] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:15 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:16.686488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:16.687410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:16.694233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:16.695293 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:16.696077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:16.696513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:19.108531 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0d87be66-c76f-455a-8855-e83ae917ca90 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 2.425972 Jan 11 04:07:19.109843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 582/1164] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:16 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:20.120554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:20.121586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:20.128518 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:20.128975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:20.129780 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:20.130221 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:20.210649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8c47a60b-94ba-4e3e-9a42-2337a5bbd0ff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 0.094599 Jan 11 04:07:20.211375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 583/1165] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:20 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:21.220978 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:21.222031 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:21.229779 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:21.230225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:21.231000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:21.231429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:21.319660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7ae18128-338b-4ac4-9f6f-2bc4d53143eb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 14 microversion: 2.20 time: 0.102737 Jan 11 04:07:21.320264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 583/1166] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:21 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:07:22.330506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:22.331506 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:22.338886 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:22.339337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:22.340114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:22.340548 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:25.597073 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e75828fd-72b7-4b10-8062-c77aa6fb819f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 21935 microversion: 2.20 time: 3.270433 Jan 11 04:07:25.597835 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 584/1167] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:22 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 21935 bytes in 3272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:26.609399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:26.610478 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:26.617366 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:26.617848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:26.618626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:26.619065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:26.706551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7bd66873-a0f9-4891-b35d-878d1aa9ea78 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 23235 microversion: 2.20 time: 0.101131 Jan 11 04:07:26.707160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 584/1168] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:26 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 23235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:27.718949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:27.719950 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:27.727879 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:27.728520 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:27.729660 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:27.730207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:27.821396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5b6bd201-eab0-4dda-8bdd-a966d857ae7a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 24839 microversion: 2.20 time: 0.105832 Jan 11 04:07:27.822310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 585/1169] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:27 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 24839 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:28.832876 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:28.833903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:28.841580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:28.842061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:28.842842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:28.843279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:32.318821 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5df952b9-65c7-49b3-928a-8cd7e51e95d3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 27879 microversion: 2.20 time: 3.489876 Jan 11 04:07:32.319465 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 585/1170] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:28 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 27879 bytes in 3492 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:33.496316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:33.498217 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:33.504203 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:33.504656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:33.505823 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:33.506263 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:33.596916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a62f49bd-7c93-4320-99dd-9a4e10931c64 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 27945 microversion: 2.20 time: 0.269292 Jan 11 04:07:33.597650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 586/1171] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:33 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 27945 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:34.609450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:34.610487 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:34.618039 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:34.618489 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:34.619271 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:34.619708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:34.714166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-25d47565-f10e-4335-9be5-9b218d45c631 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 27945 microversion: 2.20 time: 0.108565 Jan 11 04:07:34.714810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 586/1172] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:34 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 27945 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:35.726380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:35.727876 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:35.734712 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:35.735162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:35.735946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:35.736380 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:39.075899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-54c2728f-5358-452b-b572-ef8f3cf083e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28011 microversion: 2.20 time: 3.353437 Jan 11 04:07:39.076551 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 587/1173] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:35 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28011 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:40.087863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:40.088865 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:40.095686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:40.096143 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:40.096928 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:40.097367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:40.198374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bbd9bcca-e135-428a-ac71-c10175d05940 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28123 microversion: 2.20 time: 0.114222 Jan 11 04:07:40.199147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 587/1174] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:40 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28123 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:41.210334 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:41.211336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:41.219433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:41.219883 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:41.220666 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:41.221103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:41.319534 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a02f18eb-3e89-4f91-bf56-20de55518c99 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28208 microversion: 2.20 time: 0.113075 Jan 11 04:07:41.323943 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 588/1175] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:41 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28208 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:42.331751 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:42.332762 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:42.340101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:42.340553 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:42.341329 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:42.341797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:42.435054 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-531e3270-af0e-4f6f-8ef4-1da4cda2ba4a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.107368 Jan 11 04:07:42.435908 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 588/1176] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:42 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:43.447074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:43.448083 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:43.455964 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:43.456413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:43.457423 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:43.458039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:43.542497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9f11993c-88b4-4262-ba34-42e86056cc96 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.099421 Jan 11 04:07:43.543155 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 589/1177] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:43 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:07:44.554894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:44.555934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:44.563833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:44.564285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:44.565166 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:44.565608 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:44.655761 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-222f4342-53df-42fa-817c-318aa7ef227e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.105078 Jan 11 04:07:44.656923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 589/1178] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:44 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:45.668478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:45.669487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:45.676692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:45.677146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:45.677957 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:45.678398 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:45.764799 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-93c0f5c6-6236-4a1c-a5f8-7b8bf7e5814f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.100668 Jan 11 04:07:45.765447 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 590/1179] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:45 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:46.776589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:46.777521 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:46.784583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:46.785029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:46.785819 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:46.786252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:46.877265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-92318d11-11f3-43de-b011-451aa3aab699 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.105143 Jan 11 04:07:46.877970 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 590/1180] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:46 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:07:47.889327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:47.890385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:47.897337 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:47.897828 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:47.898613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:47.899050 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:47.984281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-04c61b4d-9a7b-4ecd-bfb0-ecf0ed00edc9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.099392 Jan 11 04:07:47.984898 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 591/1181] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:47 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:48.995845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:48.996962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:49.004238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:49.004776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:49.005625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:49.006181 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:49.092347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-36683ad7-0e0a-40b7-9098-e87e5ae40e35 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.100328 Jan 11 04:07:49.093253 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 591/1182] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:48 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:07:50.104012 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:50.105070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:50.111962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:50.112418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:50.113207 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:50.113649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:50.193278 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a81da8d2-0860-4c6d-93ed-4f94f678a779 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.093188 Jan 11 04:07:50.193938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 592/1183] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:50 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:51.205579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:51.206616 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:51.214158 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:51.214834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:51.215740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:51.216229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:51.306866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-23aed823-2abb-41bd-abf2-d84d9451382f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.105230 Jan 11 04:07:51.311686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 592/1184] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:51 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:52.318942 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:52.319939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:52.327199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:52.327650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:52.328437 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:52.328877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:52.409103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-28df8757-2ef4-4563-ba16-05bba407abca tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28307 microversion: 2.20 time: 0.093962 Jan 11 04:07:52.412962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 593/1185] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:52 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:53.421992 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:53.422999 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:53.430280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:53.430885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:53.431700 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:53.432145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:53.524264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-67bad7cf-d8ab-4c9b-b2e6-b49ac939acb7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28598 microversion: 2.20 time: 0.106951 Jan 11 04:07:53.524997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 593/1186] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:53 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28598 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:54.537006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:54.537961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:54.545884 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:54.546339 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:54.547134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:54.547575 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:54.633019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-16e2bdbf-d7d2-4cc5-9536-aa98d7726f62 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28598 microversion: 2.20 time: 0.100244 Jan 11 04:07:54.633700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 594/1187] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:54 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28598 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:55.645381 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:55.646422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:55.653267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:55.653736 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:55.654517 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:55.654948 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:55.751345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9479280f-6d80-4e82-8c06-5f4f3d5ce627 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.109878 Jan 11 04:07:55.752073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 594/1188] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:55 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:07:56.764019 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:56.765018 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:56.771999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:56.772442 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:56.773227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:56.773656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:56.866740 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4c7c33d7-6cf6-431d-ac98-450bea3f7f9a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.107131 Jan 11 04:07:56.867385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 595/1189] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:56 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:57.879817 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:57.880816 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:57.887501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:57.887953 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:57.888745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:57.889183 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:57.985258 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b31ed9f6-4eb9-46cf-bcd5-95ac4d69845f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.109856 Jan 11 04:07:57.985945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 595/1190] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:57 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:07:58.996894 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:07:58.998517 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:07:59.005368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:59.005853 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:59.006630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:07:59.007062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:07:59.107099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-289a975b-6e21-4798-ba8d-f9afb160b09c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.113515 Jan 11 04:07:59.108578 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 596/1191] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:07:58 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:00.119488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:00.120493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:00.127884 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:00.128328 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:00.129112 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:00.129545 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:00.213387 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-13aa883b-b6e1-45ec-8fbc-68b35bb3bf51 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.097790 Jan 11 04:08:00.214094 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 596/1192] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:00 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:01.225691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:01.227345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:01.234869 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:01.235319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:01.236114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:01.236583 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:01.343058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ec070034-8520-4220-b34c-da811a6a7183 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.121392 Jan 11 04:08:01.343717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 597/1193] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:01 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:02.355016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:02.356061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:02.362938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:02.363395 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:02.364176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:02.364614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:02.454697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d805cc61-2670-416c-b572-8ebea64a6970 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.103576 Jan 11 04:08:02.455249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 597/1194] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:02 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:03.466607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:03.468120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:03.474906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:03.475350 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:03.476131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:03.476569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:03.566602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f9f1a626-cad4-442b-b855-48655caab10f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.103909 Jan 11 04:08:03.567480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 598/1195] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:03 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:04.578651 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:04.579567 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:04.586341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:04.586810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:04.587580 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:04.588021 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:04.675623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-022d3b32-bf65-48f8-8c50-65cec062c56d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.100915 Jan 11 04:08:04.676543 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 598/1196] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:04 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:05.688210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:05.689209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:05.696035 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:05.696483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:05.697291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:05.697752 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:05.785960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1f26979f-eb89-4b78-8665-3ad36db14ef6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.102185 Jan 11 04:08:05.786667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 599/1197] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:05 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:06.798583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:06.799501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:06.806359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:06.806805 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:06.807574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:06.808001 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:06.892879 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1749646f-67c6-4285-a369-4b7a0382db70 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.098855 Jan 11 04:08:06.893600 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 599/1198] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:06 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:07.904832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:07.905874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:07.913032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:07.913484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:07.914295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:07.914733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:08.013359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0b129570-3a5c-4101-8475-b610971c8bff tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.112440 Jan 11 04:08:08.014248 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 600/1199] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:07 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:09.025886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:09.026895 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:09.034619 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:09.035073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:09.035853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:09.036291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:09.117153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f0c7f92a-8df5-49f0-891d-27517a9eb1e2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.095183 Jan 11 04:08:09.117836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 600/1200] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:09 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:10.129007 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:10.130037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:10.136938 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:10.137391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:10.138271 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:10.138713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:10.222919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e7085dc4-d04c-4139-ac5d-a45d4814599f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.097967 Jan 11 04:08:10.223555 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 601/1201] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:10 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:11.235560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:11.236498 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:11.243605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:11.244051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:11.244827 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:11.245290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:11.330715 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6861f95b-a95b-499e-8de5-401cee3b2c1b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.099728 Jan 11 04:08:11.331613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 601/1202] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:11 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:12.342700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:12.343694 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:12.350487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:12.350933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:12.351708 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:12.352141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:12.436366 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-85cc7f9b-08be-40df-bc19-b2edc674390a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.097586 Jan 11 04:08:12.437806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 602/1203] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:12 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:13.449354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:13.450389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:13.457840 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:13.458429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:13.459241 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:13.459818 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:13.544088 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-4e29dc6c-e683-43c9-b1d2-fdf4b1eb17fe tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.098937 Jan 11 04:08:13.544723 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 602/1204] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:13 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:14.556153 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:14.557182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:14.564004 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:14.564453 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:14.565227 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:14.565662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:14.657109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-208a979a-86c7-4ce3-b847-db3fa92de977 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.104692 Jan 11 04:08:14.657731 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 603/1205] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:14 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:15.669596 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:15.670647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:15.677996 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:15.678446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:15.679217 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:15.679647 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:15.770898 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a2f9068e-7f2b-4cff-a5de-8bdfb7796d3a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.105164 Jan 11 04:08:15.771530 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 603/1206] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:15 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:16.783305 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:16.784841 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:16.791699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:16.792190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:16.792970 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:16.793410 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:20.156512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d89b2248-ea92-4d65-a8fa-78ce361e9084 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 3.377418 Jan 11 04:08:20.157873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 604/1207] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:16 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 3380 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:21.168959 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:21.169901 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:21.176738 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:21.177184 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:21.178051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:21.178483 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:21.258192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9796f8c2-e1ea-46fa-9ebd-4f5cfc11a34b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.093192 Jan 11 04:08:21.258823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 604/1208] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:21 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:22.270335 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:22.271267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:22.278711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:22.279162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:22.279952 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:22.280391 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:22.360919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8e4a0b5b-32ce-40de-81df-05202a44d1e8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.094653 Jan 11 04:08:22.361770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 605/1209] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:22 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:23.373418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:23.374446 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:23.382704 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:23.383192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:23.384030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:23.384462 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:23.464542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-282fe363-2ee1-4d77-8724-cf1fd2907b9e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.095597 Jan 11 04:08:23.465500 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 605/1210] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:23 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:24.476758 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:24.477692 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:24.484585 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:24.485032 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:24.485827 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:24.486261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:24.566489 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c63b5dc1-9c97-4f7b-bcbb-9c3ecb6111f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.094321 Jan 11 04:08:24.567122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 606/1211] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:24 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:25.578933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:25.579900 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:25.586826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:25.587271 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:25.588044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:25.588478 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:25.668809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-7905c57a-3d27-431c-b1fb-459c5333afb2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.093757 Jan 11 04:08:25.669354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 606/1212] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:25 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:26.681174 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:26.682290 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:26.689712 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:26.690265 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:26.691630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:26.692074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:26.778264 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-47aa1a96-6903-4198-88c9-f5d8b52edfb9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.101196 Jan 11 04:08:26.778919 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 607/1213] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:26 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:27.791485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:27.792615 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:27.799525 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:27.799982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:27.800768 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:27.801206 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:27.884971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-20f364ab-2dcc-4cdc-bd39-e210596ffaac tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.097597 Jan 11 04:08:27.885666 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 607/1214] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:27 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:08:28.897368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:28.898457 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:28.906304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:28.907176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:28.907979 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:28.908436 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:28.995075 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0375e0f1-a70e-4836-850c-8543d5715bd3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.101686 Jan 11 04:08:29.001831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 608/1215] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:28 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:30.013066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:30.014246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:30.020847 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:30.021268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:30.022291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:30.022761 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:30.111737 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-81d70823-4344-4dd8-88d2-699df561a28c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.103288 Jan 11 04:08:30.112400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 608/1216] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:30 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:31.125105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:31.126158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:31.133862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:31.134319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:31.135126 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:31.135573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:31.220882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-09a7cc13-d39e-4321-be06-af0267d51ed1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.099712 Jan 11 04:08:31.226474 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 609/1217] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:31 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:32.241204 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:32.242327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:32.253421 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:32.253887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:32.254918 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:32.255361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:32.357845 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-211eb83a-9d34-4236-b810-143d07540c01 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 28766 microversion: 2.20 time: 0.128442 Jan 11 04:08:32.359152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 609/1218] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:32 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 28766 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:33.371052 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:33.372689 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:33.379486 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:33.380014 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:33.380878 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:33.381545 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:33.469987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c4d7cb0b-91ab-43da-a797-2e023a3f69cd tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 29732 microversion: 2.20 time: 0.102823 Jan 11 04:08:33.470936 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 610/1219] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:33 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 29732 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:34.483897 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:34.485826 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:34.503205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:34.506147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:34.509277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:34.509893 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:34.628657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-f3e16ce8-f66e-48b1-baea-7fe9ff8d583b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 31991 microversion: 2.20 time: 0.149231 Jan 11 04:08:34.629894 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 610/1220] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:34 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 31991 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:35.641485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:35.642568 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:35.658484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:35.659011 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:35.661257 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:35.661977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:35.767520 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d8946cbe-b1b5-447e-af2b-3c693f3b56f8 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 33357 microversion: 2.20 time: 0.130436 Jan 11 04:08:35.774121 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 611/1221] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:35 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 33357 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:36.552625 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Action: 'create', calling method: .version_select at 0x7f4e65884940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-325377247"}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:36.567944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:08:36.571968 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for user 3d2ca554cd9b4f0fa26b6841a8f974f3 and project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:08:36.783784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:36.784860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:36.792066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:36.792695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:36.793439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:36.794081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:36.869157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:08:36.879658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for user 3d2ca554cd9b4f0fa26b6841a8f974f3 and project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'key_pairs'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:08:36.896445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9da9009a-a678-434c-9167-e846e37c8c37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 34506 microversion: 2.20 time: 0.116874 Jan 11 04:08:36.897178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-78aa0249-de19-4eb1-9781-3fb40f6423fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.557864 Jan 11 04:08:36.898575 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 611/1223] 10.222.0.24 () {60 vars in 1157 bytes} [Tue Jan 11 04:08:36 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:08:36.903000 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 612/1223] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:36 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 34506 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:08:37.910115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:37.911220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:37.918962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:37.920281 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:37.921253 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:37.921981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:38.012284 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c183bbec-1f2e-40ce-a243-a3706f64421e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 35805 microversion: 2.20 time: 0.106516 Jan 11 04:08:38.012954 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 612/1224] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:37 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 35805 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:08:39.025903 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:39.026928 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:39.038085 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:39.038586 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:39.039381 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:39.039817 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:39.162947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1bfadb8e-1a73-4775-8936-1401fbb34ec7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 37159 microversion: 2.20 time: 0.140971 Jan 11 04:08:39.163912 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 613/1225] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:39 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 37159 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:40.175780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:40.177491 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:40.184862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:40.185445 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:40.186618 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:40.187081 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:40.308709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-706846b2-fe02-4eb3-bb58-d16ddff3e4e5 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 38312 microversion: 2.20 time: 0.136871 Jan 11 04:08:40.313601 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 613/1226] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:40 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 38312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:41.322158 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:41.323247 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:41.330193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:41.330642 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:41.331425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:41.331860 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:41.415046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ab814198-838c-4690-a81e-67afe770359f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 38312 microversion: 2.20 time: 0.097052 Jan 11 04:08:41.415705 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 614/1227] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:41 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 38312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 11 04:08:42.427280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:42.428288 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:42.435116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:42.435570 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:42.436354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:42.436793 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:42.533938 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bf08cec2-032f-404f-824e-a26f30f0ca02 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 38312 microversion: 2.20 time: 0.110499 Jan 11 04:08:42.534853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 614/1228] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:42 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 38312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:43.547798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:43.548725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:43.555626 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:43.556074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:43.556851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:43.557288 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:43.647905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e5d457c5-efbf-4714-a130-111e13ddb247 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 38312 microversion: 2.20 time: 0.104085 Jan 11 04:08:43.648564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 615/1229] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:43 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 38312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:44.660990 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:44.662130 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:44.669250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:44.669709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:44.670515 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:44.670945 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:44.768613 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8220d653-7439-4c2f-bfc1-2e377a28db16 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 200 len: 38453 microversion: 2.20 time: 0.112204 Jan 11 04:08:44.769247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 615/1230] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:44 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 38453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:08:44.779441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:44.780131 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:44.788993 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:44.789439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:44.790263 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:44.790697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:44.815289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-462603b9-eb2d-4dec-ace9-f397cd85b632 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/ips" status: 200 len: 151 microversion: 2.20 time: 0.039903 Jan 11 04:08:44.815861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 616/1231] 10.222.0.24 () {60 vars in 1288 bytes} [Tue Jan 11 04:08:44 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:08:47.039567 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:47.040116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:47.046980 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:47.047434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:47.048254 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:47.048697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:47.072303 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.objects.instance [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lazy-loading 'flavor' on Instance uuid ce8c9fcf-d6e7-4dfd-8070-3594705c082e {{(pid=116388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 11 04:08:47.432361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-30375e01-da4a-418c-8716-f9a4c8f15840 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 202 len: 0 microversion: 2.20 time: 0.396819 Jan 11 04:08:47.435741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 616/1232] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:08:47 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:08:47.440777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:47.441373 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:47.448432 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:47.448987 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:47.449871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:47.450310 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:47.626994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:47.635039 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:47.636547 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:47.637743 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a02ffbe2-eec2-40d2-981f-6c66f8e58813 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.200655 Jan 11 04:08:47.638317 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 617/1233] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:47 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:48.657075 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:48.657834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:48.663939 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:48.664394 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:48.665172 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:48.665611 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:48.793231 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:48.800853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:48.802888 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:48.804036 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9e21d1a9-b21b-4a84-a54a-0aedd63247e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.151723 Jan 11 04:08:48.804592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 617/1234] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:48 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:49.821848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:49.822465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:49.828822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:49.829275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:49.830090 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:49.830531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:49.960781 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:49.968449 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:49.969977 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:49.971185 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-15379f48-c4c0-4847-b11c-77f2e37a5fba tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.153127 Jan 11 04:08:49.971744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 618/1235] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:49 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:50.989138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:50.989801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:50.996069 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:50.996516 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:50.997293 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:50.997811 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:51.128612 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:51.136374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:51.137899 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:51.139077 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d8705e6a-b838-441f-a455-50f7eb8078f9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.153595 Jan 11 04:08:51.139626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 618/1236] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:50 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:52.157661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:52.158292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:52.165006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:52.165463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:52.166266 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:52.166713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:52.298622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:52.306940 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:52.308512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:52.309656 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-894633b1-3ffb-4f39-bbb4-27254a0920b9 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.155999 Jan 11 04:08:52.310234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 619/1237] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:52 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:53.328025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:53.328628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:53.334933 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:53.335375 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:53.336145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:53.336593 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:53.462744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:53.470519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:53.472219 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:53.473922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d65da199-02dc-45cc-ae0f-8c4251d96930 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.149049 Jan 11 04:08:53.474476 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 619/1238] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:53 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:54.491658 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:54.492176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:54.498430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:54.498884 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:54.499664 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:54.500101 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:54.628729 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:54.636962 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:54.638512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:54.639667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c7d32f5f-6561-49b6-9753-aeb1949a31de tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.151844 Jan 11 04:08:54.640224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 620/1239] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:54 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:55.657573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:55.658211 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:55.665103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:55.665552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:55.666357 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:55.666828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:55.792896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:55.800573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:55.802178 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:55.803327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ba58da01-307a-4939-b926-2dc9f4e03e9d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.149723 Jan 11 04:08:55.803875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 620/1240] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:55 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:56.820956 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:56.821552 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:56.827982 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:56.828426 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:56.829194 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:56.829629 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:56.955056 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:56.963407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:56.964906 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:56.966084 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3ce39592-4a42-4eaf-8749-08e2d2235537 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.148836 Jan 11 04:08:56.966636 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 621/1241] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:56 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:57.985320 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:57.986035 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:57.992741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:57.993205 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:57.994030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:57.994473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:58.124987 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:58.133225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:58.134765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:58.135931 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b433bb36-2898-48e8-b373-d37aa4e4c40f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.155362 Jan 11 04:08:58.136485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 621/1242] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:57 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:08:58.342387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-945719862", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-325377247", "security_groups": [{"name": "tempest-secgroup-smoke-955211354"}], "block_device_mapping_v2": [{"uuid": "4bd4fdf2-9cdf-4cd2-9924-827a33eca9bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "154598b2-54d1-4f28-9fb8-3dd81d867516"}]}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:08:58.445624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.network.neutron [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] validate_networks() for [('154598b2-54d1-4f28-9fb8-3dd81d867516', None, None, None, None, None)] {{(pid=116387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:08:58.799490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:08:58.799927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image limits 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:08:58.800430 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:08:58.800845 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image pref 0:0:0 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:08:58.801262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.virt.hardware [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:08:58.810424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:58.811576 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:58.811697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:58.812102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:58.828047 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:08:58.831883 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.quota [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for user 3d2ca554cd9b4f0fa26b6841a8f974f3 and project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:08:58.884875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Going to run 1 instances... {{(pid=116387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:08:58.887069 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bd4fdf2-9cdf-4cd2-9924-827a33eca9bb',volume_size=None,volume_type=None)] {{(pid=116387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:08:59.008137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4d4fcf6a-f72f-4a01-9bb7-397c347c230c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.669207 Jan 11 04:08:59.008710 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 622/1243] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:08:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:08:59.018279 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-337d254d-1d06-4e34-9792-7cd90e5d6ba8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:59.018891 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-337d254d-1d06-4e34-9792-7cd90e5d6ba8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:59.070765 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-337d254d-1d06-4e34-9792-7cd90e5d6ba8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:59.077218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-337d254d-1d06-4e34-9792-7cd90e5d6ba8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1093 microversion: 2.1 time: 0.062622 Jan 11 04:08:59.077806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 622/1244] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:08:59 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:08:59.154166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:08:59.154801 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:08:59.160892 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:59.161333 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:59.162777 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:08:59.163236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:08:59.292848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:59.300687 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:59.302295 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:08:59.303459 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5f0331b6-a04f-4e68-82dd-e5b60057f0ec tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.152935 Jan 11 04:08:59.309730 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 623/1245] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:08:59 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:00.094831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:00.095636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:00.102890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:00.103425 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:00.104468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:00.104911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:00.176798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:00.185085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d8d141ec-1b84-4e98-be42-78ca3361e870 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1209 microversion: 2.1 time: 0.094233 Jan 11 04:09:00.185639 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 623/1246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:00 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:00.320463 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:00.321081 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:00.327796 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:00.328252 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:00.329066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:00.329513 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:00.715246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:00.723348 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:00.725565 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:00.727144 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-002ffd61-2972-4205-ac27-6b212fd83412 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.410551 Jan 11 04:09:00.727711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 624/1247] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:00 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:09:01.206275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:01.206921 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:01.217862 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:01.218323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:01.219138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:01.219583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:01.472073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:01.479610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-63e1c3ca-4074-4b02-b88c-0017cba25371 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.281295 Jan 11 04:09:01.480188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 624/1248] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:01 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:01.745345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:01.745967 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:01.752959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:01.753622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:01.754749 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:01.755234 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:01.939305 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-3b438c9d-e161-43da-8e8c-9f20e03536e5 req-25d8b7cf-6a95-49ee-9661-d990097d1fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50a0ebd-52ce-4908-9b75-02d9c551e0fb", "tag": "a5d2e6ac-991c-4f91-ab13-f957d546b191"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:01.940885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:01.940885 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:09:01.952220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-3b438c9d-e161-43da-8e8c-9f20e03536e5 req-25d8b7cf-6a95-49ee-9661-d990097d1fb5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:01.953061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-3b438c9d-e161-43da-8e8c-9f20e03536e5 req-25d8b7cf-6a95-49ee-9661-d990097d1fb5 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:01.965453 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-3b438c9d-e161-43da-8e8c-9f20e03536e5 req-25d8b7cf-6a95-49ee-9661-d990097d1fb5 service nova] Creating event network-changed:a5d2e6ac-991c-4f91-ab13-f957d546b191 for instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb on hv-cinder-81977 Jan 11 04:09:01.970835 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-3b438c9d-e161-43da-8e8c-9f20e03536e5 req-25d8b7cf-6a95-49ee-9661-d990097d1fb5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117761 Jan 11 04:09:01.971652 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 625/1249] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:09:01.987953 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:01.997023 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:01.998560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:01.999945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4dcaa30b-af3f-44a4-954e-12933ab2ec37 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.258338 Jan 11 04:09:02.000605 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 625/1250] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:01 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:02.497043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:02.497801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:02.503852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:02.504291 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:02.506189 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:02.506636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:02.738685 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:02.745824 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b6616a98-74ed-4c44-9bb2-3b02590f747c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.253206 Jan 11 04:09:02.746390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 626/1251] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:02 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:03.017726 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:03.018272 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:03.024693 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:03.025169 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:03.025999 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:03.026441 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:03.157778 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:03.165948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:03.167449 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:03.168632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-748d937c-593b-4bc0-8712-5133eee6ee7f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.154787 Jan 11 04:09:03.169190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 626/1252] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:03 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:03.762290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:03.762896 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:03.769121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:03.769565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:03.771066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:03.771491 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:03.896730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:03.904065 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-21d5b653-c75a-4d19-a40c-bb77961d0b02 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.145470 Jan 11 04:09:03.904626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 627/1253] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:03 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:04.186982 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:04.187590 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:04.194609 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:04.194921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:04.195736 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:04.196170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:04.331058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:04.338832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:04.340336 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:04.341492 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-908c4947-ade2-400e-b7fb-0449aa368b41 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1743 microversion: 2.20 time: 0.158228 Jan 11 04:09:04.342099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 627/1254] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:04 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:04.921338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:04.922040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:04.928909 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:04.929353 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:04.930150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:04.930582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:05.059544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:05.067102 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-475fb9a1-f929-4c33-b1a3-110bd95dfdc4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.149480 Jan 11 04:09:05.067679 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 628/1255] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:04 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:05.359465 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:05.360070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:05.366394 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:05.366843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:05.367616 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:05.368051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:05.495022 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:05.502713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:05.504219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:05.505913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-61fc877d-9219-40ec-a17b-a7725f74982f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1743 microversion: 2.20 time: 0.150122 Jan 11 04:09:05.506480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 628/1256] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:05 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:06.083511 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:06.084113 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:06.090367 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:06.090814 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:06.091582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:06.092016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:06.218152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:06.225850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-deb81006-6d56-47f4-a533-107fb7ccb0f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.145945 Jan 11 04:09:06.226411 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 629/1257] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:06 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:06.423497 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-30f2d88f-4182-44d8-8bab-29e1a308ec11 req-c0f0d601-2118-45e0-a3a5-eaae0d791971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "name": "network-vif-plugged", "status": "completed", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:06.425445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:06.425445 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:09:06.433340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-30f2d88f-4182-44d8-8bab-29e1a308ec11 req-c0f0d601-2118-45e0-a3a5-eaae0d791971 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:06.433821 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-30f2d88f-4182-44d8-8bab-29e1a308ec11 req-c0f0d601-2118-45e0-a3a5-eaae0d791971 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:06.444593 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-30f2d88f-4182-44d8-8bab-29e1a308ec11 req-c0f0d601-2118-45e0-a3a5-eaae0d791971 service nova] Creating event network-vif-plugged:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:09:06.449475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-30f2d88f-4182-44d8-8bab-29e1a308ec11 req-c0f0d601-2118-45e0-a3a5-eaae0d791971 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090892 Jan 11 04:09:06.450074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 629/1258] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:09:06.523346 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:06.523952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:06.529843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:06.530285 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:06.531059 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:06.531488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:06.658727 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:06.667049 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:06.668560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:06.669731 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d9f75978-556d-4c89-a2da-a6d8ffe82648 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1743 microversion: 2.20 time: 0.150574 Jan 11 04:09:06.670272 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 630/1259] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:06 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:07.242434 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:07.243059 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:07.249105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:07.249562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:07.250377 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:07.250822 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:07.376877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:07.384105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e9aa548f-8de8-4fc2-804e-3360c3540e82 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.146379 Jan 11 04:09:07.384673 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 630/1260] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:07 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:07.687533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:07.688137 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:07.694936 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:07.695384 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:07.696180 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:07.696623 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:07.820838 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:07.828424 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:07.829952 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:07.831095 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d5735e54-f101-4030-9667-69f780349d04 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1743 microversion: 2.20 time: 0.147303 Jan 11 04:09:07.831641 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 631/1261] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:07 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1743 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:08.400062 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:08.400678 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:08.407378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:08.407803 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:08.408632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:08.409088 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:08.539554 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:08.547015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7134306e-0794-4394-9cfd-31e250eddf29 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.150630 Jan 11 04:09:08.547581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 631/1262] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:08 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:08.849901 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:08.850504 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:08.856812 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:08.857252 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:08.858049 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:08.858485 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:08.984223 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:08.991881 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:08.993410 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:08.994605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6dfebb49-7869-4da5-ab08-d751b84d8808 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1743 microversion: 2.20 time: 0.149075 Jan 11 04:09:08.995172 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 632/1263] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:08 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:09.563891 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:09.564508 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:09.570813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:09.571262 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:09.572043 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:09.572480 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:09.701093 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:09.708859 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5780754c-4b25-4d9c-b492-ee57d2dc3575 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.148055 Jan 11 04:09:09.709606 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 632/1264] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:09 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:10.012539 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:10.013179 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:10.019472 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:10.019917 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:10.020815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:10.021776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:10.153062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:10.161325 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:10.162842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:10.164207 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c00271ef-ba55-4a80-ba5b-d038eab4d377 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.155945 Jan 11 04:09:10.164759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 633/1265] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:10 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:10.725889 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:10.726428 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:10.732910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:10.733369 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:10.734188 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:10.734849 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:10.893005 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:10.902344 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f95c7e72-108d-4813-ad6a-9e6d53830e7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.181300 Jan 11 04:09:10.903288 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 633/1266] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:10 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:11.182302 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:11.183798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:11.190903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:11.191606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:11.192815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:11.193516 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:11.346949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:11.358067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:11.359915 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:11.361175 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0e17d60b-b56e-4a07-973c-3f4fed771f61 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.182536 Jan 11 04:09:11.362144 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 634/1267] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:11 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:11.921183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:11.922178 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:11.928450 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:11.928900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:11.929701 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:11.930154 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:12.073239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:12.081327 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d1387101-16c2-4d94-a6ac-506353718913 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.164368 Jan 11 04:09:12.081927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 634/1268] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:11 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:12.382042 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:12.382764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:12.390011 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:12.391018 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:12.392267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:12.392842 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:12.477267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-da4975ad-a33b-46f5-8227-8df624191e6e req-df7e2f2f-b996-4e7b-98f1-618a702ba997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50a0ebd-52ce-4908-9b75-02d9c551e0fb", "name": "network-vif-plugged", "status": "completed", "tag": "a5d2e6ac-991c-4f91-ab13-f957d546b191"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:12.479389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:12.479389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:09:12.488096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-da4975ad-a33b-46f5-8227-8df624191e6e req-df7e2f2f-b996-4e7b-98f1-618a702ba997 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:12.488720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-da4975ad-a33b-46f5-8227-8df624191e6e req-df7e2f2f-b996-4e7b-98f1-618a702ba997 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:12.502150 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-da4975ad-a33b-46f5-8227-8df624191e6e req-df7e2f2f-b996-4e7b-98f1-618a702ba997 service nova] Creating event network-vif-plugged:a5d2e6ac-991c-4f91-ab13-f957d546b191 for instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb on hv-cinder-81977 Jan 11 04:09:12.514172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-da4975ad-a33b-46f5-8227-8df624191e6e req-df7e2f2f-b996-4e7b-98f1-618a702ba997 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 Jan 11 04:09:12.514913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 635/1269] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:09:12.570383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:12.583678 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:12.586318 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:12.588297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e06fa638-78b8-4b8f-a403-8fe1e6092fcc tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.211883 Jan 11 04:09:12.589171 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 635/1270] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:12 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:13.100946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:13.101700 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:13.110633 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:13.111644 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:13.112560 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:13.113098 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:13.257304 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:13.266555 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-98bd7dfd-3b3b-4740-b4f5-d69a9b1e09e8 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1264 microversion: 2.1 time: 0.170819 Jan 11 04:09:13.267431 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 636/1271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:13 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:13.606834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:13.608238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:13.616825 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:13.617356 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:13.618249 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:13.618713 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:13.756043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:13.764648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:13.766415 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:13.767786 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0caeffa1-67cc-40e8-b864-80c7884d93e7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.165255 Jan 11 04:09:13.768341 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 636/1272] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:13 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:14.284478 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:14.285105 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:14.292092 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.292843 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:14.293948 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.294602 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:14.443424 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:14.451509 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ef60692b-2b2c-4ccf-a56b-0c90dfc920bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1451 microversion: 2.1 time: 0.171066 Jan 11 04:09:14.457834 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 637/1273] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:14 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:14.469260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:14.469260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:14.478115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.478565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:14.479493 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.479963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:14.632730 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:14.640574 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0920f076-8585-40db-86f9-e07168f2af9c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1451 microversion: 2.1 time: 0.176500 Jan 11 04:09:14.641507 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 637/1274] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:09:14 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:09:14.788931 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:14.790412 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:14.798905 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.800109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:14.801530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:14.802371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:15.010481 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:15.019118 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:15.021523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:15.022946 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-233c1ff9-d826-44a6-8994-11a539ce3fab tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.238670 Jan 11 04:09:15.025733 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 638/1275] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:14 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:16.042275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:16.044116 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:16.051439 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:16.052854 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:16.055016 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:16.055803 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:16.360397 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:16.371235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:16.371235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:16.373262 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1abf39e8-bbf2-4f38-8ae7-e074a9c07e3c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.334671 Jan 11 04:09:16.385100 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 638/1276] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:16 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:16.963109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-b6a5be26-d4f7-472c-a2a5-57b0ab5f104d req-2e0d1d24-254d-4d40-967f-c35cd0222701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50a0ebd-52ce-4908-9b75-02d9c551e0fb", "tag": "a5d2e6ac-991c-4f91-ab13-f957d546b191"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:16.965216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:16.965216 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:09:16.977291 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-b6a5be26-d4f7-472c-a2a5-57b0ab5f104d req-2e0d1d24-254d-4d40-967f-c35cd0222701 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:16.978794 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-b6a5be26-d4f7-472c-a2a5-57b0ab5f104d req-2e0d1d24-254d-4d40-967f-c35cd0222701 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:16.996828 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-b6a5be26-d4f7-472c-a2a5-57b0ab5f104d req-2e0d1d24-254d-4d40-967f-c35cd0222701 service nova] Creating event network-changed:a5d2e6ac-991c-4f91-ab13-f957d546b191 for instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb on hv-cinder-81977 Jan 11 04:09:17.003126 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-b6a5be26-d4f7-472c-a2a5-57b0ab5f104d req-2e0d1d24-254d-4d40-967f-c35cd0222701 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043492 Jan 11 04:09:17.004030 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 639/1277] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:09:17.391778 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:17.393366 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:17.404268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:17.404732 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:17.405529 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:17.405997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:17.650802 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:17.667130 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:17.668667 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:17.669932 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a4388e3d-dec7-4149-9dc0-b75bd65090c2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.282139 Jan 11 04:09:17.681657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 639/1278] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:17 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:18.689974 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:18.690697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:18.698114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:18.698592 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:18.699562 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:18.700055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:18.843160 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:18.851212 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:18.852727 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:18.853925 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fca1a8d9-2ed6-494a-b2da-074725e0b46e tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.169046 Jan 11 04:09:18.854530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 640/1279] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:18 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:19.872240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:19.872852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:19.879114 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:19.879565 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:19.880848 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:19.881282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:20.006200 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:20.013922 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:20.015436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:20.016630 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-91476933-0e48-4f03-8460-b244204f73b0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1738 microversion: 2.20 time: 0.148154 Jan 11 04:09:20.017193 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 640/1280] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:19 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:21.035790 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:21.037087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:21.043300 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:21.043753 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:21.044542 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:21.044975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:21.171697 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:21.179314 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:21.180819 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:21.182006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e997228e-b587-49a8-a13e-2347dddd7d1d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1720 microversion: 2.20 time: 0.150188 Jan 11 04:09:21.182564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 641/1281] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:21 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:22.200558 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:22.201111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:22.207469 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:22.207920 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:22.208698 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:22.209139 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:22.349617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:22.357606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:22.359191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:22.360358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-dbdba5f6-1f73-44f3-9c7b-54535e7fa691 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1720 microversion: 2.20 time: 0.163636 Jan 11 04:09:22.360923 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 641/1282] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:22 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:22.480356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-e0374b28-501e-4693-b4a0-a4b769f74803 req-2dad19af-e492-451d-a734-6739b844dc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "name": "network-vif-unplugged", "status": "completed", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:22.481944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:22.481944 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:09:22.489259 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e0374b28-501e-4693-b4a0-a4b769f74803 req-2dad19af-e492-451d-a734-6739b844dc20 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:22.489735 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-e0374b28-501e-4693-b4a0-a4b769f74803 req-2dad19af-e492-451d-a734-6739b844dc20 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:22.500579 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-e0374b28-501e-4693-b4a0-a4b769f74803 req-2dad19af-e492-451d-a734-6739b844dc20 service nova] Creating event network-vif-unplugged:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:09:22.505365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-e0374b28-501e-4693-b4a0-a4b769f74803 req-2dad19af-e492-451d-a734-6739b844dc20 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028641 Jan 11 04:09:22.506006 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 642/1283] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:09:23.378240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:23.378853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:23.385766 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.386220 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:23.387029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.387468 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:23.511579 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:23.519176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:23.520671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:23.521852 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-69f5d460-05ef-4a41-b674-bd4e1b74e70b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1663 microversion: 2.20 time: 0.147316 Jan 11 04:09:23.522408 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 642/1284] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:23 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:09:23.540737 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9395c36e-98ce-412f-84cb-1b5f3747ec03"}} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:23.541899 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:23.548444 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.548893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:23.549668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.550129 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:23.790994 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d95a9486-9cfb-48b3-bbe4-40e0dc004bb0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.255361 Jan 11 04:09:23.791579 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 643/1285] 10.222.0.24 () {62 vars in 1363 bytes} [Tue Jan 11 04:09:23 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments => generated 188 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 11 04:09:23.894655 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:23.895177 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:23.901475 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.901964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:23.902749 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:23.903188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:24.129400 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e3a38d6e-8ee2-40c1-b0d5-707cb2ae71bb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments/9395c36e-98ce-412f-84cb-1b5f3747ec03" status: 202 len: 0 microversion: 2.20 time: 0.238425 Jan 11 04:09:24.130025 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 643/1286] 10.222.0.24 () {60 vars in 1456 bytes} [Tue Jan 11 04:09:23 2022] DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments/9395c36e-98ce-412f-84cb-1b5f3747ec03 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:09:24.181901 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:24.182483 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:24.188219 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:24.188661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:24.189427 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:24.189897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:24.265992 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7a6c9f1c-1d1e-4bea-998b-bdda57f06b05 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action" status: 202 len: 0 microversion: 2.20 time: 0.087762 Jan 11 04:09:24.266924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 644/1287] 10.222.0.24 () {62 vars in 1318 bytes} [Tue Jan 11 04:09:24 2022] POST /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:09:24.275603 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:24.276217 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:24.283009 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:24.283463 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:24.284290 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:24.284726 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:24.419978 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:24.428576 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:24.430109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:24.431259 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a9176614-bac7-48b5-bac9-6f57a026a3b7 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1671 microversion: 2.20 time: 0.160165 Jan 11 04:09:24.431841 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 644/1288] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:24 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:25.449685 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:25.450357 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:25.456968 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:25.457418 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:25.458237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:25.459187 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:25.647413 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:25.655258 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:25.656767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:25.658210 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d39e2540-9cba-46c7-b12d-dc0b48e5518d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.212272 Jan 11 04:09:25.658770 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 645/1289] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:25 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:26.676147 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:26.676689 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:26.683135 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:26.683582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:26.684363 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:26.685017 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:26.817427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:26.826195 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:26.828043 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:26.829440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-583c754e-6611-4389-bf92-03860c69015b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.157061 Jan 11 04:09:26.830380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 645/1290] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:26 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:27.847558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:27.848162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:27.855218 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:27.855661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:27.856439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:27.856876 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:28.000487 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:28.009385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:28.010927 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:28.012102 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6ebdad97-5184-4a4a-8eaf-f5456f910a91 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.168272 Jan 11 04:09:28.012657 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 646/1291] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:27 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:29.030518 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:29.031142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:29.038572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:29.039022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:29.039801 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:29.040238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:29.174145 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:29.182759 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:29.186461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:29.186461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-65167800-8373-4090-bf65-fb1037f30de2 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.158855 Jan 11 04:09:29.186461 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 646/1292] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:29 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:09:30.204387 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:30.205074 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:30.212865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:30.213276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:30.214096 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:30.214527 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:30.355704 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:30.363805 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:30.365323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:30.366500 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a8f1a396-8c61-468c-84dc-746f8f0d71cb tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.165994 Jan 11 04:09:30.367055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 647/1293] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:30 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:31.385637 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:31.386265 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:31.392686 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:31.393121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:31.393934 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:31.394380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:31.541209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:31.552141 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:31.554255 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:31.555656 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8f7b7f66-0219-4ebb-915f-0dd7394075f6 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.173667 Jan 11 04:09:31.556470 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 647/1294] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:31 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:32.575376 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:32.575973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:32.582876 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:32.583342 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:32.584282 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:32.584725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:32.721087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:32.729875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:32.731405 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:32.732580 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-76a0b26f-6830-41a7-8193-1f5ce469c106 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.162676 Jan 11 04:09:32.733134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 648/1295] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:32 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:33.751323 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:33.751977 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:33.760007 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:33.760492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:33.761383 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:33.761853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:33.897253 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:33.905269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:33.906798 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:33.908419 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-1704c8ca-017a-4c0f-9b49-0eca382541e0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.160817 Jan 11 04:09:33.909235 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 648/1296] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:33 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:34.926830 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:34.927448 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:34.934612 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:34.935066 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:34.935851 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:34.936289 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:35.077955 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:35.086222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:35.087739 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:35.088945 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-b15e71b5-338a-4024-b324-b83dd21dd25b tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.165873 Jan 11 04:09:35.089501 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 649/1297] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:34 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:36.107321 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:36.107911 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:36.114218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:36.114670 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:36.115455 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:36.116538 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:36.244347 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:36.252067 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:36.253564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:36.254744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-35879e61-800a-46d5-a26d-3b255711171d tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.151112 Jan 11 04:09:36.255300 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 649/1298] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:36 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:37.272176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:37.272699 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:37.278668 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:37.279120 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:37.279900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:37.280345 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:37.410702 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:37.418949 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:37.420460 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:37.421613 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-13bd3954-09cc-4a15-aefb-d5870b701f59 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.153385 Jan 11 04:09:37.422208 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 650/1299] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:37 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:38.439464 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:38.440073 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:38.446058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:38.446508 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:38.447282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:38.447717 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:38.576078 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:38.583744 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:38.585237 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:38.586420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-12299114-519c-4349-9f28-3828ef7c6e17 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.150724 Jan 11 04:09:38.586974 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 650/1300] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:38 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:39.604117 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:39.604718 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:39.611020 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:39.611471 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:39.612282 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:39.612717 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:39.740546 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:39.748686 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:39.750214 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:39.751359 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6ae36b50-c788-4d44-a47d-2a376e1db7a0 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.150975 Jan 11 04:09:39.751917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 651/1301] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:39 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:40.769614 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:40.770190 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:40.776997 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:40.777444 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:40.778242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:40.778677 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:40.903998 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:40.911958 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:40.913452 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:40.914636 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-23567cff-9eed-4d43-bb4b-1a3c096fcf39 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.148823 Jan 11 04:09:40.915390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 651/1302] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:40 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:41.933237 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:41.933877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:41.940113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:41.940563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:41.941340 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:41.941806 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:42.069195 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:42.076960 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:42.078502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:42.079650 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ade4223d-01c1-40b1-b7f3-f9b5b7470cc3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.150190 Jan 11 04:09:42.080200 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 652/1303] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:41 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:42.498426 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-430016a0-dcac-4076-ba52-0538fe9fe861 req-aeda7af1-8ae4-44e4-b085-8edae38c4229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "name": "network-vif-plugged", "status": "completed", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:09:42.500019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:09:42.500019 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:09:42.508701 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-430016a0-dcac-4076-ba52-0538fe9fe861 req-aeda7af1-8ae4-44e4-b085-8edae38c4229 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:42.509142 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-430016a0-dcac-4076-ba52-0538fe9fe861 req-aeda7af1-8ae4-44e4-b085-8edae38c4229 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:42.521496 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-430016a0-dcac-4076-ba52-0538fe9fe861 req-aeda7af1-8ae4-44e4-b085-8edae38c4229 service nova] Creating event network-vif-plugged:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:09:42.526586 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-430016a0-dcac-4076-ba52-0538fe9fe861 req-aeda7af1-8ae4-44e4-b085-8edae38c4229 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031727 Jan 11 04:09:42.527173 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 652/1304] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:09:43.097222 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:43.097861 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:43.104610 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:43.105055 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:43.105865 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:43.106303 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:43.233038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:43.240908 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:43.242467 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:43.243624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-8609d96b-b167-4a73-98ed-bb01e64d3d4c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.150100 Jan 11 04:09:43.244181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 653/1305] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:43 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 11 04:09:44.262374 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:44.263085 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:44.271420 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:44.271882 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:44.272683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:44.273130 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:44.412029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:44.421000 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:44.422564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:44.423748 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-e670265e-4f21-4bf2-87e2-3479276369c3 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1729 microversion: 2.20 time: 0.165425 Jan 11 04:09:44.424309 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 653/1306] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:44 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:09:45.442531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:09:45.443138 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:09:45.450037 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:45.450485 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:45.451261 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:09:45.451695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:09:45.578735 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:45.586433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:45.587953 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:09:45.589109 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fdc524f9-0ede-431d-9b59-334e993f495c tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1716 microversion: 2.20 time: 0.150347 Jan 11 04:09:45.589667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 654/1307] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:09:45 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:10:40.971385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:40.972335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:40.979163 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:40.979617 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:40.980436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:40.980877 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:41.008566 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9e4cc519-6bcd-4ea1-9859-c38d9fc87cc1 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040964 Jan 11 04:10:41.009112 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 654/1308] 10.222.0.24 () {60 vars in 1342 bytes} [Tue Jan 11 04:10:40 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:10:41.062665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:41.063166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:41.069360 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:41.069871 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:41.070662 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:41.071104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:41.095491 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:10:41.171746 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bc7e3e53-e8f0-4ca0-afa1-c8f33bc21e57 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 204 len: 0 microversion: 2.20 time: 0.112329 Jan 11 04:10:41.172233 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 655/1309] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Jan 11 04:10:41 2022] DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 04:10:41.180239 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:41.180853 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:41.186735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:41.187191 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:41.187979 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:41.188418 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:41.317014 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:41.324688 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:41.326240 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:41.327399 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0e6a4dc2-975c-4229-9d62-efea351f8b15 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.150895 Jan 11 04:10:41.327957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 655/1310] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:41 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:10:42.346122 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:42.346874 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:42.353082 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:42.353532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:42.354356 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:42.354792 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:42.479665 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:42.487229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:42.489229 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:42.490475 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-fb8d0a50-217b-4d28-bb30-6434f986e1be tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1722 microversion: 2.20 time: 0.148497 Jan 11 04:10:42.491027 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 656/1311] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:42 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:10:43.509225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:43.509976 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:43.516414 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:43.516866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:43.517654 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:43.518121 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:43.582944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:43.590873 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:43.592532 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4392e543394fb9ae2b6bb2a5810e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed38b3c7d84dab859ca3e64c19a348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:10:43.593771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ba12e133-bfa6-4340-afc0-9d87b766bd8f tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 200 len: 1655 microversion: 2.20 time: 0.088213 Jan 11 04:10:43.594540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 656/1312] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:43 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 1655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 11 04:10:43.632046 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-dc267640-83f8-4bc3-a2f1-4f28021d3906 req-30df3b75-3e57-4333-9a9c-6223b4693dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce8c9fcf-d6e7-4dfd-8070-3594705c082e", "name": "network-vif-deleted", "tag": "ee42ef12-a352-43d6-8796-7ffb7b89536e"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:10:43.633791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:10:43.633791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:10:43.642774 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-dc267640-83f8-4bc3-a2f1-4f28021d3906 req-30df3b75-3e57-4333-9a9c-6223b4693dd7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:43.643223 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-dc267640-83f8-4bc3-a2f1-4f28021d3906 req-30df3b75-3e57-4333-9a9c-6223b4693dd7 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:43.655517 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-dc267640-83f8-4bc3-a2f1-4f28021d3906 req-30df3b75-3e57-4333-9a9c-6223b4693dd7 service nova] Creating event network-vif-deleted:ee42ef12-a352-43d6-8796-7ffb7b89536e for instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e on hv-cinder-81977 Jan 11 04:10:43.661935 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-dc267640-83f8-4bc3-a2f1-4f28021d3906 req-30df3b75-3e57-4333-9a9c-6223b4693dd7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Jan 11 04:10:43.665900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 657/1313] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:10:44.612115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:44.612743 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:44.619774 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:44.620209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:44.621099 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:44.621540 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:44.634534 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. Jan 11 04:10:44.635111 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:10:44.636251 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8a18ea76-f880-4ced-873b-adc819686f75 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 404 len: 111 microversion: 2.20 time: 0.027591 Jan 11 04:10:44.636916 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 657/1314] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:44 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:10:44.646510 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-97273bda-4975-44db-934f-61a7b003ec09 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '.version_select at 0x7f4e6634cca0>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:44.663597 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-97273bda-4975-44db-934f-61a7b003ec09 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597873558" status: 204 len: 0 microversion: 2.20 time: 0.021559 Jan 11 04:10:44.664143 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 658/1315] 10.222.0.24 () {60 vars in 1261 bytes} [Tue Jan 11 04:10:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597873558 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 11 04:10:46.417645 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:46.418162 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:46.424330 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:46.424776 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:46.425544 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:46.426005 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:46.438724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. Jan 11 04:10:46.439314 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:10:46.440115 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-5cbf17df-e4e8-4c7e-b6b9-d5e375a25b10 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 404 len: 111 microversion: 2.20 time: 0.026200 Jan 11 04:10:46.440712 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 658/1316] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Jan 11 04:10:46 2022] DELETE /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:10:46.448573 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:46.449313 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: ce8c9fcf-d6e7-4dfd-8070-3594705c082e] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:46.457642 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:46.458112 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:46.459398 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:46.459832 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:46.472519 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. Jan 11 04:10:46.473100 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance ce8c9fcf-d6e7-4dfd-8070-3594705c082e could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:10:46.473939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-bba9ea2e-e322-46d0-8960-f3fe83f90575 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e" status: 404 len: 111 microversion: 2.20 time: 0.029482 Jan 11 04:10:46.475150 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 659/1317] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:46 2022] GET /compute/v2.1/servers/ce8c9fcf-d6e7-4dfd-8070-3594705c082e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:10:47.598331 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:47.598823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:47.605572 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:47.606061 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:47.606831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:47.607264 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:47.620823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. Jan 11 04:10:47.621390 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:10:47.622222 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-6e67ca69-9d66-426f-985c-798aee69c904 tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 404 len: 111 microversion: 2.20 time: 0.028208 Jan 11 04:10:47.622740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 659/1318] 10.222.0.24 () {60 vars in 1279 bytes} [Tue Jan 11 04:10:47 2022] DELETE /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:10:47.630324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:10:47.630958 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] [instance: 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:10:47.637171 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:47.637604 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:47.638407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:10:47.638848 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:10:47.651455 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] HTTP exception thrown: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. Jan 11 04:10:47.652025 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] Returning 404 to user: Instance 7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:10:47.652814 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c3a4e37b-0cfd-4428-b055-3075669b457a tempest-AttachVolumeShelveTestJSON-597480397 tempest-AttachVolumeShelveTestJSON-597480397-project] 10.222.0.24 "GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c" status: 404 len: 111 microversion: 2.20 time: 0.026226 Jan 11 04:10:47.653321 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 660/1319] 10.222.0.24 () {60 vars in 1276 bytes} [Tue Jan 11 04:10:47 2022] GET /compute/v2.1/servers/7e4048e3-2c6f-4c1e-95f0-4b7e0862dd9c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 11 04:11:32.310436 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:32.311058 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:32.318101 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:32.318564 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:32.319371 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:32.319815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:32.347858 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Going to try to terminate instance {{(pid=116388) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:11:32.430028 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-0aaafe01-5758-40fb-a5c1-353ace8d6055 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 204 len: 0 microversion: 2.1 time: 0.121966 Jan 11 04:11:32.430573 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 660/1320] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:11:32 2022] DELETE /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:11:32.438679 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:32.439309 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:32.445947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:32.446400 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:32.447209 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:32.447842 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:32.783751 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:32.793810 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0d58e7b7-439c-4ddb-9e95-addd0255458d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1576 microversion: 2.1 time: 0.358941 Jan 11 04:11:32.794604 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 661/1321] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:32 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1576 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 11 04:11:33.812473 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:33.813385 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:33.819815 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:33.820389 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:33.821269 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:33.821964 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:33.973628 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:33.981513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3e344e11-fbf4-478e-ba74-0f7f8a7c8ac3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1576 microversion: 2.1 time: 0.173366 Jan 11 04:11:33.982093 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 661/1322] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:33 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:34.998141 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:34.998797 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:35.005135 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:35.006125 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:35.006910 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:35.007353 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:35.071292 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:35.078543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-1db96463-4b14-48f6-812d-5fda3a19e72c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 200 len: 1509 microversion: 2.1 time: 0.084085 Jan 11 04:11:35.079110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 662/1323] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:34 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 1509 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:35.148610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-32ab9b98-f2e8-4caa-a73b-87ca15a70c46 req-e3e57008-e7b4-422a-98ee-2d0fe6c40702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50a0ebd-52ce-4908-9b75-02d9c551e0fb", "name": "network-vif-deleted", "tag": "a5d2e6ac-991c-4f91-ab13-f957d546b191"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:11:35.150497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:11:35.150497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:11:35.159057 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-32ab9b98-f2e8-4caa-a73b-87ca15a70c46 req-e3e57008-e7b4-422a-98ee-2d0fe6c40702 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:35.159506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-32ab9b98-f2e8-4caa-a73b-87ca15a70c46 req-e3e57008-e7b4-422a-98ee-2d0fe6c40702 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:35.171426 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-32ab9b98-f2e8-4caa-a73b-87ca15a70c46 req-e3e57008-e7b4-422a-98ee-2d0fe6c40702 service nova] Creating event network-vif-deleted:a5d2e6ac-991c-4f91-ab13-f957d546b191 for instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb on hv-cinder-81977 Jan 11 04:11:35.176828 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-32ab9b98-f2e8-4caa-a73b-87ca15a70c46 req-e3e57008-e7b4-422a-98ee-2d0fe6c40702 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040213 Jan 11 04:11:35.178306 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 662/1324] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:11:36.095959 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:36.096720 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:36.106747 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:36.107368 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:36.108205 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:36.108646 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:36.124301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] HTTP exception thrown: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. Jan 11 04:11:36.124913 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Returning 404 to user: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:11:36.125980 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0790a952-50d5-4e1a-9413-588015691192 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 404 len: 111 microversion: 2.1 time: 0.033863 Jan 11 04:11:36.126635 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 663/1325] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:36 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:11:36.224859 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-253804280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-325377247", "security_groups": [{"name": "tempest-secgroup-smoke-955211354"}], "block_device_mapping_v2": [{"uuid": "4bd4fdf2-9cdf-4cd2-9924-827a33eca9bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "154598b2-54d1-4f28-9fb8-3dd81d867516"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:11:36.343413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] validate_networks() for [('154598b2-54d1-4f28-9fb8-3dd81d867516', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:11:36.808813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:11:36.809233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:11:36.809755 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:11:36.810167 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:11:36.810577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:11:36.819719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:36.820458 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:36.821305 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:36.821764 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:36.838658 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:11:36.842578 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for user 3d2ca554cd9b4f0fa26b6841a8f974f3 and project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:11:36.897546 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:11:36.899875 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bd4fdf2-9cdf-4cd2-9924-827a33eca9bb',volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:11:37.023450 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: ERROR oslo.messaging._drivers.impl_rabbit [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [06e69361-a1d1-4117-9034-e7f05f42ebab] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 11 04:11:38.033192 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [06e69361-a1d1-4117-9034-e7f05f42ebab] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 37852. Jan 11 04:11:38.037989 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-019082be-f6c2-4332-ad62-6cd9538a0250 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.817517 Jan 11 04:11:38.038657 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 663/1326] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:11:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:11:38.048541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-f1ff451c-1488-4e7e-a88f-98ed7e92a06e tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:38.049132 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-f1ff451c-1488-4e7e-a88f-98ed7e92a06e tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:38.104791 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-f1ff451c-1488-4e7e-a88f-98ed7e92a06e tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:38.111622 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-f1ff451c-1488-4e7e-a88f-98ed7e92a06e tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1093 microversion: 2.1 time: 0.066772 Jan 11 04:11:38.112190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 664/1327] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:38 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:39.128322 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:39.129104 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:39.135806 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:39.136261 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:39.137051 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:39.137496 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:39.196533 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:39.203666 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-d779d71b-6b76-440f-8da8-31d27194b208 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1191 microversion: 2.1 time: 0.079446 Jan 11 04:11:39.204233 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 664/1328] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:39 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:40.221275 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:40.221930 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:40.229407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:40.230137 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:40.230933 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:40.231438 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:40.448454 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:40.456183 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-68be99dc-6deb-4c54-a5e5-d5c3d6b2e95b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.238556 Jan 11 04:11:40.456941 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 665/1329] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:40 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:40.776706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-839a609d-793d-43a9-b4e1-9877b86b1fab req-80563dac-c878-4ddc-a9e0-1c8528cbb8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd35f5b-8fc5-4365-82a2-a2c37bc0352d", "tag": "35ddef3e-7e08-46a7-8909-9288a9ba7830"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:11:40.779008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:11:40.779008 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:11:40.788161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-839a609d-793d-43a9-b4e1-9877b86b1fab req-80563dac-c878-4ddc-a9e0-1c8528cbb8a0 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:40.788912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-839a609d-793d-43a9-b4e1-9877b86b1fab req-80563dac-c878-4ddc-a9e0-1c8528cbb8a0 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:40.800378 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-839a609d-793d-43a9-b4e1-9877b86b1fab req-80563dac-c878-4ddc-a9e0-1c8528cbb8a0 service nova] Creating event network-changed:35ddef3e-7e08-46a7-8909-9288a9ba7830 for instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d on hv-cinder-81977 Jan 11 04:11:40.805795 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-839a609d-793d-43a9-b4e1-9877b86b1fab req-80563dac-c878-4ddc-a9e0-1c8528cbb8a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Jan 11 04:11:40.806683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 665/1330] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:11:41.472766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:41.473375 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:41.480159 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:41.480603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:41.481381 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:41.481844 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:41.671649 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:41.680652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d7fac3c1-c35f-436d-b299-140412d3ef5d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.211417 Jan 11 04:11:41.681242 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 666/1331] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:41 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:42.698610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:42.699335 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:42.705361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:42.705836 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:42.706610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:42.707045 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:42.840947 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:42.848340 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-af0915fc-bc8d-4c8a-81c0-1d4a9aeaa0ab tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.154517 Jan 11 04:11:42.848957 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 666/1332] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:42 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:43.863815 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:43.865087 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:43.871170 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:43.871618 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:43.872396 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:43.872828 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:44.001558 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:44.008744 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-5d2de224-d5d3-4d80-84fe-8cdd0247eee9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.148572 Jan 11 04:11:44.009301 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 667/1333] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:43 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:45.024963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:45.025607 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:45.032007 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:45.032724 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:45.033502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:45.033965 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:45.162552 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:45.169754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ca53da05-a108-45e8-97b9-53a6aee75f83 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.148389 Jan 11 04:11:45.170246 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 667/1334] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:45 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:46.186784 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:46.187420 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:46.194325 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:46.194765 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:46.195535 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:46.195966 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:46.326099 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:46.333287 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-ff353fe0-6982-4c84-ae05-09c3e615d83a tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.150235 Jan 11 04:11:46.333870 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 668/1335] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:46 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:47.348697 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:47.349301 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:47.355693 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:47.356136 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:47.356903 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:47.357327 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:47.485275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:47.492582 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-476372c7-b7ff-46f0-a675-70f3ba7b30c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.147503 Jan 11 04:11:47.493754 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 668/1336] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:47 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:48.509632 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:48.510267 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:48.516603 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:48.517058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:48.517873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:48.518316 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:48.646399 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:48.653512 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c8f242b9-eeba-4785-a5e0-439649cb8c42 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.147563 Jan 11 04:11:48.654107 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 669/1337] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:48 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:49.670551 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:49.671161 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:49.677413 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:49.677912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:49.678694 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:49.679138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:49.807201 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:49.814492 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-72c16a16-ca66-4f04-b928-a92db287fc52 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.147549 Jan 11 04:11:49.815062 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 669/1338] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:49 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:50.831246 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:50.831882 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:50.838713 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:50.839164 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:50.839947 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:50.840385 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:50.967256 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:50.975061 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e2ac0ea8-89ad-426c-b31f-544444b7e5c5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.147470 Jan 11 04:11:50.975624 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 670/1339] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:50 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:51.991188 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:51.991832 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:51.998052 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:51.998514 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:51.999297 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:51.999737 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:52.128861 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:52.136103 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-3340f1a1-4a1d-48bc-95e9-2c8818b8e62f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.149231 Jan 11 04:11:52.136660 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 670/1340] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:51 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:53.152323 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:53.153015 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:53.159719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:53.160166 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:53.161538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:53.162179 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:53.190734 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-0b704767-2ae6-4056-9d55-97933d240a2c req-0296c6ca-33c2-4c01-b354-d84880e83295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd35f5b-8fc5-4365-82a2-a2c37bc0352d", "name": "network-vif-plugged", "status": "completed", "tag": "35ddef3e-7e08-46a7-8909-9288a9ba7830"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:11:53.192833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:11:53.192833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:11:53.202440 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0b704767-2ae6-4056-9d55-97933d240a2c req-0296c6ca-33c2-4c01-b354-d84880e83295 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:53.203150 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-0b704767-2ae6-4056-9d55-97933d240a2c req-0296c6ca-33c2-4c01-b354-d84880e83295 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:53.215092 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-0b704767-2ae6-4056-9d55-97933d240a2c req-0296c6ca-33c2-4c01-b354-d84880e83295 service nova] Creating event network-vif-plugged:35ddef3e-7e08-46a7-8909-9288a9ba7830 for instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d on hv-cinder-81977 Jan 11 04:11:53.220358 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-0b704767-2ae6-4056-9d55-97933d240a2c req-0296c6ca-33c2-4c01-b354-d84880e83295 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Jan 11 04:11:53.221146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 671/1341] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:11:53.296433 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:53.303863 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-a6874393-e013-449c-8f06-360914c0a7aa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.155230 Jan 11 04:11:53.304378 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 671/1342] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:53 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:54.320758 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:54.321577 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:54.328482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:54.328959 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:54.329866 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:54.330302 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:54.459165 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:54.466434 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ceecf6a5-ff96-4ff0-a6c4-d294caa1ecd1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1264 microversion: 2.1 time: 0.149868 Jan 11 04:11:54.466995 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 672/1343] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:54 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:55.483097 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:55.483709 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:55.490449 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:55.490893 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:55.491695 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:55.492113 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:55.624711 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:55.632521 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e4c98043-2623-45e7-b329-615bb3c03162 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1452 microversion: 2.1 time: 0.153158 Jan 11 04:11:55.633104 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 672/1344] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:55 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:55.648913 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:11:55.649526 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:11:55.656160 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:55.656610 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:55.657703 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:55.658133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:55.794813 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:11:55.803372 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-b8bb5845-89fa-4c04-b560-666589f3e0f3 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1452 microversion: 2.1 time: 0.158120 Jan 11 04:11:55.803944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 673/1345] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:11:55 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:11:57.614414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-5a8d8d72-fc87-46a0-80b4-ee3416f2e9cc req-655563bc-5f09-4839-81e9-80dba762fa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd35f5b-8fc5-4365-82a2-a2c37bc0352d", "tag": "35ddef3e-7e08-46a7-8909-9288a9ba7830"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:11:57.615921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:11:57.615921 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:11:57.623078 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-5a8d8d72-fc87-46a0-80b4-ee3416f2e9cc req-655563bc-5f09-4839-81e9-80dba762fa4e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:11:57.623515 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-5a8d8d72-fc87-46a0-80b4-ee3416f2e9cc req-655563bc-5f09-4839-81e9-80dba762fa4e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:11:57.634162 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-5a8d8d72-fc87-46a0-80b4-ee3416f2e9cc req-655563bc-5f09-4839-81e9-80dba762fa4e service nova] Creating event network-changed:35ddef3e-7e08-46a7-8909-9288a9ba7830 for instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d on hv-cinder-81977 Jan 11 04:11:57.639645 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-5a8d8d72-fc87-46a0-80b4-ee3416f2e9cc req-655563bc-5f09-4839-81e9-80dba762fa4e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028659 Jan 11 04:11:57.640456 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 673/1346] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:12:24.154268 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:12:24.154916 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:12:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:13:56.654887 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-437184230", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-325377247", "security_groups": [{"name": "tempest-secgroup-smoke-955211354"}], "block_device_mapping_v2": [{"uuid": "80bfd32e-8654-4b33-847b-eed930bc443f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "154598b2-54d1-4f28-9fb8-3dd81d867516"}]}} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:13:56.887774 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.network.neutron [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] validate_networks() for [('154598b2-54d1-4f28-9fb8-3dd81d867516', None, None, None, None, None)] {{(pid=116388) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 11 04:13:57.239943 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 11 04:13:57.240364 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image limits 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 11 04:13:57.240833 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Flavor pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 11 04:13:57.241238 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Image pref 0:0:0 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 11 04:13:57.241644 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.virt.hardware [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 11 04:13:57.250146 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:57.250587 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:57.251392 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:57.251823 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:57.267488 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 11 04:13:57.271299 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.quota [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Getting quotas for user 3d2ca554cd9b4f0fa26b6841a8f974f3 and project c470bb66f30a4a099e5f10e72c657c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 11 04:13:57.324718 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Going to run 1 instances... {{(pid=116388) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 11 04:13:57.326949 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80bfd32e-8654-4b33-847b-eed930bc443f',volume_size=None,volume_type=None)] {{(pid=116388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 11 04:13:57.443659 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-81513094-9851-4e35-9a71-255c9ce63fa1 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793204 Jan 11 04:13:57.444234 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 674/1347] 10.222.0.24 () {60 vars in 1146 bytes} [Tue Jan 11 04:13:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 11 04:13:57.453875 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5b13262-bcea-4a16-9e23-4256fc15fa91] AMQP server on 10.222.0.24:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 11 04:13:57.457897 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-e1eba1a3-3b06-4dc2-a7a7-fa2a095d71c7 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:13:57.458696 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-e1eba1a3-3b06-4dc2-a7a7-fa2a095d71c7 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:13:57.569163 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-e1eba1a3-3b06-4dc2-a7a7-fa2a095d71c7 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:13:57.576858 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-e1eba1a3-3b06-4dc2-a7a7-fa2a095d71c7 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1093 microversion: 2.1 time: 0.126131 Jan 11 04:13:57.583190 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 674/1348] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:13:57 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:13:58.595152 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:13:58.595708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:13:58.608454 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:58.609345 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:58.610760 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:58.611242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:58.683745 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:13:58.691477 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-56803f53-4fcf-43ad-9273-763c53f343a4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1209 microversion: 2.1 time: 0.101329 Jan 11 04:13:58.692056 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 675/1349] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:13:58 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:13:59.696273 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-4ddeb06c-8208-41e6-a385-1411af1aa744 req-66a5955b-4491-4a01-85bd-73c6121c23e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661ba919-cae2-4b71-8e10-30ad71525a2f", "tag": "4058ed83-8336-419e-842c-4f9eaae670aa"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:13:59.698225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:13:59.698225 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:13:59.708341 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-4ddeb06c-8208-41e6-a385-1411af1aa744 req-66a5955b-4491-4a01-85bd-73c6121c23e4 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:59.709211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-4ddeb06c-8208-41e6-a385-1411af1aa744 req-66a5955b-4491-4a01-85bd-73c6121c23e4 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:59.710482 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:13:59.711737 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:13:59.718963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:59.719750 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:59.722667 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-4ddeb06c-8208-41e6-a385-1411af1aa744 req-66a5955b-4491-4a01-85bd-73c6121c23e4 service nova] Creating event network-changed:4058ed83-8336-419e-842c-4f9eaae670aa for instance 661ba919-cae2-4b71-8e10-30ad71525a2f on hv-cinder-81977 Jan 11 04:13:59.739971 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-4ddeb06c-8208-41e6-a385-1411af1aa744 req-66a5955b-4491-4a01-85bd-73c6121c23e4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047946 Jan 11 04:13:59.741022 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:13:59.742250 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:13:59.742389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 675/1350] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:13:59.963280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:13:59.970800 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c8acd8a9-6fef-4359-9d19-7512f6f8e754 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.265966 Jan 11 04:13:59.971360 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 676/1351] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:13:59 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:00.988057 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:00.988750 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:00.994439 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5b13262-bcea-4a16-9e23-4256fc15fa91] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 38092. Jan 11 04:14:00.996538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:00.996990 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:00.998330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:00.998766 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:01.387772 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:01.394998 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3c218a2d-13eb-4f7e-b3d3-cc35e3229038 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.410917 Jan 11 04:14:01.395563 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 676/1352] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:00 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:02.411729 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:02.412338 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:02.418831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:02.419380 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:02.420247 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:02.420649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:02.552029 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:02.561427 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-bf493f89-850b-4b4a-b56d-1fdcea9c57d4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.152588 Jan 11 04:14:02.561860 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 677/1353] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:02 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:03.578165 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:03.578785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:03.585051 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:03.585502 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:03.586319 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:03.586779 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:03.714831 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:03.722631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d434156e-0f31-4704-84f6-d91cf1bba0c6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.148760 Jan 11 04:14:03.723193 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 677/1354] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:03 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:04.739109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:04.739648 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:04.745912 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:04.746359 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:04.747125 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:04.747560 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:04.875771 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:04.883143 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-67420fa6-ed49-4819-a90d-0eb616748a95 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.147803 Jan 11 04:14:04.883708 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 678/1355] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:04 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:05.899850 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:05.900490 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:05.906753 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:05.907199 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:05.908247 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:05.908683 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:06.038785 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:06.046532 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-6caf7b31-e405-4886-87f0-bc2a8ccc3f3f tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.150665 Jan 11 04:14:06.047110 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 678/1356] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:05 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:07.063550 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:07.064186 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:07.070157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:07.070606 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:07.071403 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:07.071834 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:07.196851 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:07.204671 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-9cf96a1e-0bba-4bff-98b8-7b54047440e5 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.145440 Jan 11 04:14:07.205225 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 679/1357] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:07 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:08.221691 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:08.222236 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:08.228525 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:08.228975 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:08.229789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:08.230224 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:08.356973 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:08.364390 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cf6c39c0-421c-4b8a-b593-73e375441438 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.146480 Jan 11 04:14:08.364984 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 679/1358] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:08 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:09.202554 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:14:09.203038 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:14:09.380407 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:09.381010 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:09.387263 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:09.387706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:09.389066 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:09.389497 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:09.519379 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:09.526581 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ab9f6228-8404-4b50-ae26-bf6c885115bb tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.149750 Jan 11 04:14:09.527155 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 680/1359] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:09 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:10.543114 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:10.543630 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:10.549825 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:10.550270 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:10.551034 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:10.551464 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:10.679342 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:10.687026 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-4e32b446-dee6-45c5-b459-8a16eedaeb90 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.147617 Jan 11 04:14:10.687581 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 680/1360] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:10 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:11.703176 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:11.703809 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:11.709907 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:11.710354 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:11.711138 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:11.711568 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:11.802939 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [req-4a5a20a7-8ab2-47af-a501-511d5fbd4a45 req-f61af4d4-8efb-4521-acb0-0ca92322e36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661ba919-cae2-4b71-8e10-30ad71525a2f", "name": "network-vif-plugged", "status": "completed", "tag": "4058ed83-8336-419e-842c-4f9eaae670aa"}]} {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:14:11.805053 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:14:11.805053 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: warnings.warn(msg) Jan 11 04:14:11.812080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-4a5a20a7-8ab2-47af-a501-511d5fbd4a45 req-f61af4d4-8efb-4521-acb0-0ca92322e36a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:11.812531 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [req-4a5a20a7-8ab2-47af-a501-511d5fbd4a45 req-f61af4d4-8efb-4521-acb0-0ca92322e36a service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:11.823631 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.compute.server_external_events [req-4a5a20a7-8ab2-47af-a501-511d5fbd4a45 req-f61af4d4-8efb-4521-acb0-0ca92322e36a service nova] Creating event network-vif-plugged:4058ed83-8336-419e-842c-4f9eaae670aa for instance 661ba919-cae2-4b71-8e10-30ad71525a2f on hv-cinder-81977 Jan 11 04:14:11.829211 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [req-4a5a20a7-8ab2-47af-a501-511d5fbd4a45 req-f61af4d4-8efb-4521-acb0-0ca92322e36a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090112 Jan 11 04:14:11.829813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 681/1361] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:14:11.851588 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:11.859030 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-41b50c86-0493-4902-849e-de10309aa4b0 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.160008 Jan 11 04:14:11.859592 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 681/1362] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:11 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:12.876569 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:12.877260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:12.883274 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:12.883715 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:12.884484 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:12.884924 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:13.016611 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:13.023824 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-c29c4545-5708-4498-9494-10d103037e59 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1264 microversion: 2.1 time: 0.151814 Jan 11 04:14:13.024377 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 682/1363] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:12 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:14.040890 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:14.041503 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:14.048369 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:14.048820 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:14.049605 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:14.050070 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:14.176740 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:14.184091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-ca240f6f-7a4e-4c48-a581-b43ae5659868 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1451 microversion: 2.1 time: 0.146872 Jan 11 04:14:14.185275 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 682/1364] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:14 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:14.200564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:14:14.201176 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:14:14.207414 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:14.207864 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:14.208641 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:14.209080 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:14.336868 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:14:14.344675 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d4266b63-5d21-4b29-beb3-445caa06fd7c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1451 microversion: 2.1 time: 0.147773 Jan 11 04:14:14.345239 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 683/1365] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:14:14 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:14:15.914843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-dddbb0c7-b7ce-45bf-abe0-960a35e308fd req-ac93a8b8-3e85-4b63-949b-fef620a81997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661ba919-cae2-4b71-8e10-30ad71525a2f", "tag": "4058ed83-8336-419e-842c-4f9eaae670aa"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:14:15.916535 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:14:15.916535 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:14:15.923402 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-dddbb0c7-b7ce-45bf-abe0-960a35e308fd req-ac93a8b8-3e85-4b63-949b-fef620a81997 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:14:15.923843 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-dddbb0c7-b7ce-45bf-abe0-960a35e308fd req-ac93a8b8-3e85-4b63-949b-fef620a81997 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:14:15.934506 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-dddbb0c7-b7ce-45bf-abe0-960a35e308fd req-ac93a8b8-3e85-4b63-949b-fef620a81997 service nova] Creating event network-changed:4058ed83-8336-419e-842c-4f9eaae670aa for instance 661ba919-cae2-4b71-8e10-30ad71525a2f on hv-cinder-81977 Jan 11 04:14:15.940124 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-dddbb0c7-b7ce-45bf-abe0-960a35e308fd req-ac93a8b8-3e85-4b63-949b-fef620a81997 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086836 Jan 11 04:14:15.940709 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 683/1366] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:15:44.162798 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:15:44.163401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:15:59.716530 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:15:59.717172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:16:05.963204 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:05.963813 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:05.966218 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-9bcfb438-40ae-4d13-9ced-539321224f65 req-079dcf2b-9827-48c7-9b79-54f387c45661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "661ba919-cae2-4b71-8e10-30ad71525a2f", "tag": "4058ed83-8336-419e-842c-4f9eaae670aa"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:16:05.968268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:16:05.968268 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:16:05.969814 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:05.970276 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:05.971070 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:05.971538 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:05.975525 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-9bcfb438-40ae-4d13-9ced-539321224f65 req-079dcf2b-9827-48c7-9b79-54f387c45661 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:05.975971 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-9bcfb438-40ae-4d13-9ced-539321224f65 req-079dcf2b-9827-48c7-9b79-54f387c45661 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:05.986706 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-9bcfb438-40ae-4d13-9ced-539321224f65 req-079dcf2b-9827-48c7-9b79-54f387c45661 service nova] Creating event network-changed:4058ed83-8336-419e-842c-4f9eaae670aa for instance 661ba919-cae2-4b71-8e10-30ad71525a2f on hv-cinder-81977 Jan 11 04:16:05.991886 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-9bcfb438-40ae-4d13-9ced-539321224f65 req-079dcf2b-9827-48c7-9b79-54f387c45661 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030999 Jan 11 04:16:05.992472 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 684/1367] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:16:05.998095 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:16:06.083330 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-52aeb796-a771-41c7-bf68-88fb767af502 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "DELETE /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 204 len: 0 microversion: 2.1 time: 0.124956 Jan 11 04:16:06.084389 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 684/1368] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:16:05 2022] DELETE /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:16:06.093227 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:06.094260 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:06.101780 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:06.102280 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:06.103083 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:06.103519 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:06.335914 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:06.344040 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-c6715e3e-a848-4d39-bdd9-68c7a4e3ae33 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1576 microversion: 2.1 time: 0.254761 Jan 11 04:16:06.353735 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 685/1369] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:06 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:07.361651 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:07.362371 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:07.368725 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:07.369172 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:07.369988 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:07.370425 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:07.507181 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:07.514800 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-70e5ffb4-3aca-4d19-9e28-45a498ec28dd tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1457 microversion: 2.1 time: 0.157126 Jan 11 04:16:07.515362 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 685/1370] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:07 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:08.365741 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-a4b0b15d-de44-45a1-a926-33c0cf48823c req-f19caa48-4fef-42ee-a991-b518b4289f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "661ba919-cae2-4b71-8e10-30ad71525a2f", "name": "network-vif-deleted", "tag": "4058ed83-8336-419e-842c-4f9eaae670aa"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:16:08.367355 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:16:08.367355 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:16:08.375675 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a4b0b15d-de44-45a1-a926-33c0cf48823c req-f19caa48-4fef-42ee-a991-b518b4289f83 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:08.376122 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-a4b0b15d-de44-45a1-a926-33c0cf48823c req-f19caa48-4fef-42ee-a991-b518b4289f83 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:08.387963 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-a4b0b15d-de44-45a1-a926-33c0cf48823c req-f19caa48-4fef-42ee-a991-b518b4289f83 service nova] Creating event network-vif-deleted:4058ed83-8336-419e-842c-4f9eaae670aa for instance 661ba919-cae2-4b71-8e10-30ad71525a2f on hv-cinder-81977 Jan 11 04:16:08.393429 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-a4b0b15d-de44-45a1-a926-33c0cf48823c req-f19caa48-4fef-42ee-a991-b518b4289f83 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031239 Jan 11 04:16:08.394091 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 686/1371] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:16:08.532053 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:08.533297 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:08.539873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:08.540324 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:08.541134 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:08.541574 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:08.604390 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:08.612146 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-9255a63a-b66c-4075-9414-bf2b1c7e43b2 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 200 len: 1224 microversion: 2.1 time: 0.083690 Jan 11 04:16:08.612867 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 686/1372] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:08 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:09.630935 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:09.631638 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 661ba919-cae2-4b71-8e10-30ad71525a2f] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:09.638133 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:09.638583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:09.639361 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:09.639796 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:09.654229 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] HTTP exception thrown: Instance 661ba919-cae2-4b71-8e10-30ad71525a2f could not be found. Jan 11 04:16:09.654799 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Returning 404 to user: Instance 661ba919-cae2-4b71-8e10-30ad71525a2f could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:16:09.655602 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-a4a53997-ea86-4cc8-800a-b592fa4bcbe6 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f" status: 404 len: 111 microversion: 2.1 time: 0.029188 Jan 11 04:16:09.656117 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 687/1373] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:09 2022] GET /compute/v2.1/servers/661ba919-cae2-4b71-8e10-30ad71525a2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:16:12.669140 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:12.669652 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:12.671282 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-ca169343-2fd9-42e7-b904-b7d44feda53c req-3749d7aa-bd89-4154-829c-eff5e1bcd36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd35f5b-8fc5-4365-82a2-a2c37bc0352d", "tag": "35ddef3e-7e08-46a7-8909-9288a9ba7830"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:16:12.672929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:16:12.672929 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:16:12.675759 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:12.676213 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:12.677038 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:12.677661 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:12.680556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-ca169343-2fd9-42e7-b904-b7d44feda53c req-3749d7aa-bd89-4154-829c-eff5e1bcd36e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:12.681224 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-ca169343-2fd9-42e7-b904-b7d44feda53c req-3749d7aa-bd89-4154-829c-eff5e1bcd36e service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:12.692944 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-ca169343-2fd9-42e7-b904-b7d44feda53c req-3749d7aa-bd89-4154-829c-eff5e1bcd36e service nova] Creating event network-changed:35ddef3e-7e08-46a7-8909-9288a9ba7830 for instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d on hv-cinder-81977 Jan 11 04:16:12.698277 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-ca169343-2fd9-42e7-b904-b7d44feda53c req-3749d7aa-bd89-4154-829c-eff5e1bcd36e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030499 Jan 11 04:16:12.698946 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 688/1374] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 11 04:16:12.706407 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Going to try to terminate instance {{(pid=116387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 11 04:16:12.796809 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-d5e9bd5b-f7b5-4ae8-a028-facd6bb8e32d tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 204 len: 0 microversion: 2.1 time: 0.131223 Jan 11 04:16:12.797712 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 687/1375] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:16:12 2022] DELETE /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 11 04:16:12.805868 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:12.806589 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:12.812779 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:12.813232 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:12.814337 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:12.814863 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:13.042308 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.policy [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116388) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:13.050499 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-657b5ac8-6034-48d8-b3f1-6a98f5fee455 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1577 microversion: 2.1 time: 0.248664 Jan 11 04:16:13.051797 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 689/1376] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:12 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:14.068900 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:14.069607 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:14.075873 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:14.076329 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:14.077119 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:14.077564 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:14.208881 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:14.216198 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-7c92b1be-2d31-4393-8c8b-3c3826e927fa tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1458 microversion: 2.1 time: 0.151816 Jan 11 04:16:14.216771 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 688/1377] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:14 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1458 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:15.018501 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [req-4f91d259-9de5-4846-a1bc-55adbe2785b5 req-136c8bad-6c7a-43a4-be0d-932f3922cc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd35f5b-8fc5-4365-82a2-a2c37bc0352d", "name": "network-vif-deleted", "tag": "35ddef3e-7e08-46a7-8909-9288a9ba7830"}]} {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 11 04:16:15.020683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 11 04:16:15.020683 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: warnings.warn(msg) Jan 11 04:16:15.029593 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4f91d259-9de5-4846-a1bc-55adbe2785b5 req-136c8bad-6c7a-43a4-be0d-932f3922cc51 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:15.030086 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [req-4f91d259-9de5-4846-a1bc-55adbe2785b5 req-136c8bad-6c7a-43a4-be0d-932f3922cc51 service nova] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:15.041719 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.compute.server_external_events [req-4f91d259-9de5-4846-a1bc-55adbe2785b5 req-136c8bad-6c7a-43a4-be0d-932f3922cc51 service nova] Creating event network-vif-deleted:35ddef3e-7e08-46a7-8909-9288a9ba7830 for instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d on hv-cinder-81977 Jan 11 04:16:15.047649 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [req-4f91d259-9de5-4846-a1bc-55adbe2785b5 req-136c8bad-6c7a-43a4-be0d-932f3922cc51 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032555 Jan 11 04:16:15.048556 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 690/1378] 10.222.0.24 () {64 vars in 1317 bytes} [Tue Jan 11 04:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 11 04:16:15.232767 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:15.233288 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:15.239514 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:15.239961 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:15.240745 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:15.241182 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:15.303523 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.policy [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2ca554cd9b4f0fa26b6841a8f974f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470bb66f30a4a099e5f10e72c657c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 11 04:16:15.312148 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-3ab1b9b4-7f32-466f-94bc-6c3fa10b13f9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 200 len: 1224 microversion: 2.1 time: 0.083006 Jan 11 04:16:15.312929 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 689/1379] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:15 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 11 04:16:16.328513 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:16.329209 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:16.335599 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.336044 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.336810 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.337243 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.350267 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] HTTP exception thrown: Instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d could not be found. Jan 11 04:16:16.350831 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Returning 404 to user: Instance 3bd35f5b-8fc5-4365-82a2-a2c37bc0352d could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:16:16.351626 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-02c3b8b7-0279-4947-90e0-abdd5b21960b tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d" status: 404 len: 111 microversion: 2.1 time: 0.027173 Jan 11 04:16:16.352140 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 691/1380] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:16 2022] GET /compute/v2.1/servers/3bd35f5b-8fc5-4365-82a2-a2c37bc0352d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:16:16.784862 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:16.786058 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.compute.api [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:16.792628 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.793079 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.794103 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.794541 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG oslo_concurrency.lockutils [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.808260 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.wsgi [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] HTTP exception thrown: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. Jan 11 04:16:16.808877 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Returning 404 to user: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. {{(pid=116387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:16:16.809719 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-cd539626-a731-40d9-ba2e-bd3e1ff7e2f4 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 404 len: 111 microversion: 2.1 time: 0.028922 Jan 11 04:16:16.810281 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 690/1381] 10.222.0.24 () {58 vars in 1238 bytes} [Tue Jan 11 04:16:16 2022] DELETE /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 11 04:16:16.818242 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '>' {{(pid=116388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:16.818850 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.compute.api [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] [instance: b50a0ebd-52ce-4908-9b75-02d9c551e0fb] Fetching instance by UUID {{(pid=116388) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 11 04:16:16.824712 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.825157 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.825962 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 11 04:16:16.826422 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG oslo_concurrency.lockutils [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Lock "3b467d92-0504-42b7-a6ab-b2a53e25b100" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 11 04:16:16.839583 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.wsgi [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] HTTP exception thrown: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. Jan 11 04:16:16.840153 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: DEBUG nova.api.openstack.wsgi [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Returning 404 to user: Instance b50a0ebd-52ce-4908-9b75-02d9c551e0fb could not be found. {{(pid=116388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 11 04:16:16.840981 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO nova.api.openstack.requestlog [None req-8be350c8-f56c-45b5-9e28-33becb3478a9 tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb" status: 404 len: 111 microversion: 2.1 time: 0.026457 Jan 11 04:16:16.841502 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: [pid: 116388|app: 0|req: 692/1382] 10.222.0.24 () {58 vars in 1235 bytes} [Tue Jan 11 04:16:16 2022] GET /compute/v2.1/servers/b50a0ebd-52ce-4908-9b75-02d9c551e0fb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 11 04:16:18.111544 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: DEBUG nova.api.openstack.wsgi [None req-0b80fd5d-d2c3-4684-9bb3-fe426c74fa4c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] Calling method '.version_select at 0x7f4e658a2c10>' {{(pid=116387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 11 04:16:18.137186 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO nova.api.openstack.requestlog [None req-0b80fd5d-d2c3-4684-9bb3-fe426c74fa4c tempest-TestVolumeBootPattern-103262215 tempest-TestVolumeBootPattern-103262215-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-325377247" status: 202 len: 0 microversion: 2.1 time: 0.029195 Jan 11 04:16:18.137789 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: [pid: 116387|app: 0|req: 691/1383] 10.222.0.24 () {58 vars in 1259 bytes} [Tue Jan 11 04:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-325377247 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 11 04:17:29.210856 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:17:29.211377 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:19:04.171365 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:19:04.171888 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:19:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:19:05.676542 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:19:05.677109 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:19:19.724917 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:19:19.725543 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:19:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:19:25.425089 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:19:25.425667 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:19:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:19:26.459889 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:19:26.460401 dv-cinder-819778-4-iscsi devstack@n-api.service[116387]: Tue Jan 11 04:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 11 04:20:49.218977 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 11 04:20:49.219982 dv-cinder-819778-4-iscsi devstack@n-api.service[116388]: Tue Jan 11 04:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!